-- Logs begin at Wed 2022-07-20 08:55:59 UTC, end at Wed 2022-07-20 09:53:35 UTC. -- Jul 20 09:26:58.678839 dv-cinder-822822-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 09:26:58.688613 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 09:26:58 2022] *** Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: nodename: dv-cinder-822822-3-iscsi Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: machine: x86_64 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: clock source: unix Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: pcre jit disabled Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: detected number of CPU cores: 4 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: current working directory: / Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: detected binary path: /usr/bin/uwsgi-core Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: your processes number limit is 47680 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: your memory page size is 4096 bytes Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: detected max file descriptor number: 2048 Jul 20 09:26:58.690587 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: lock engine: pthread robust mutexes Jul 20 09:26:58.691500 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: thunder lock: enabled Jul 20 09:26:58.691500 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 09:26:58.691500 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 09:26:58.735058 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: Python main interpreter initialized at 0x55a4a3bd09c0 Jul 20 09:26:58.735058 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: python threads support enabled Jul 20 09:26:58.735058 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: your server socket listen backlog is limited to 100 connections Jul 20 09:26:58.735058 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: your mercy for graceful operations on workers is 90 seconds Jul 20 09:26:58.735414 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 09:26:58.735414 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: *** Operational MODE: preforking *** Jul 20 09:26:58.735674 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: *** uWSGI is running in multiple interpreter mode *** Jul 20 09:26:58.735674 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: spawned uWSGI master process (pid: 103406) Jul 20 09:26:58.735861 dv-cinder-822822-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 09:26:58.736948 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 1 (pid: 103407, cores: 1) Jul 20 09:26:58.736948 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 2 (pid: 103408, cores: 1) Jul 20 09:26:58.736948 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 09:26:59.395433 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:26:59.400696 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:27:00.514987 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:27:00.514987 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 20 09:27:00.515586 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:27:00.515586 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 20 09:27:00.524295 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:27:00.524295 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 20 09:27:00.524725 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:27:00.524725 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 20 09:27:02.982273 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:27:02.982861 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:27:02.983037 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:27:02.983422 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:27:02.983679 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:27:02.984064 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.984389 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.984710 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.985026 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.985353 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.985659 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.985978 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.986296 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.986620 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.986880 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.987196 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.987542 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-3-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.987862 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.988168 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.988476 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.988791 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.989099 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.989419 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.989721 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.990218 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.990664 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.990972 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.991297 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.991649 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.991962 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.992268 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.992587 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.992897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.993221 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.993423 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:27:02.993802 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.993883 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:27:02.993964 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-3-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.994197 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:27:02.994301 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.994509 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.994592 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:27:02.994790 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:27:02.994895 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995166 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995251 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995511 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995602 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995828 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.995918 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.996142 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.996746 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.997060 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.997373 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.997462 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.997694 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.997779 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998013 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998112 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998329 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998421 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998648 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998732 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998903 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.998985 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999214 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999327 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999558 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-3-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999653 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999875 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:02.999969 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000177 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000262 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000473 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000558 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000711 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.000804 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001024 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001122 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001343 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001438 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001659 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001749 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.001981 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002158 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002263 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002463 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002548 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002769 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.002853 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003075 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003172 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003405 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003508 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003714 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.003799 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004019 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004114 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004324 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004408 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004624 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004708 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.004931 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005028 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005229 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005313 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005532 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005618 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-3-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005847 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.005933 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006163 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006260 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006484 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006570 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006790 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.006876 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007109 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007203 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007496 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007582 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007765 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.007857 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008071 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008242 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008409 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008500 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008723 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.008814 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009029 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009128 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009337 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009423 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009649 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009735 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.009945 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010044 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010244 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010330 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010546 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010636 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010859 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.010945 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011160 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011258 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011480 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011579 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011726 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.011819 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.012561 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.012929 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013124 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013257 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013397 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013492 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013718 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.013803 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014039 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014134 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014289 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014376 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014537 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014623 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014851 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.014962 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015169 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015267 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015495 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015584 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015801 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.015899 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016104 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016189 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016406 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016500 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016707 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.016805 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017007 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017092 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017306 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017392 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017607 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017701 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017914 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.017998 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018218 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018305 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018617 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018821 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.018906 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019133 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019225 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019465 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019560 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019771 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.019865 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020071 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020155 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020379 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020464 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020682 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020775 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.020990 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021074 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021294 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021391 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021595 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021681 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021891 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.021975 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022192 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022286 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022493 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022577 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022807 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.022916 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023111 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023209 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023436 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023524 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023682 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023782 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.023976 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024069 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024274 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024369 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024585 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024679 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024881 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.024966 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025183 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025305 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025477 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025589 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025767 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.025866 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026065 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026183 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026366 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026465 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026665 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026763 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.026964 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.027063 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.027264 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.027407 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.027723 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.028140 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.028231 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.028453 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.028551 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.028759 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.028847 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.029062 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.029160 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.029378 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.029477 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.029694 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.029794 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.029997 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.030087 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.030299 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.030388 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.030600 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.030698 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.030901 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.031004 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.031217 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.031340 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.031540 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.031629 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.031841 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.031941 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.032156 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.032262 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.032459 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.032556 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.032761 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.032849 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.033073 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.033169 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.033379 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.033488 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.033679 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.033774 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.033990 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.034085 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.034286 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.034373 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.034588 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.034680 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.034898 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.034997 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.035199 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.035325 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.035528 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.035706 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.035824 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.035957 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.036120 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.036282 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.036417 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.036606 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.036715 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.036919 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.037012 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.037233 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.037318 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.037544 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.037631 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.037865 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.037952 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.038165 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.038284 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.038467 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.038555 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.038768 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.038853 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.039067 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.039152 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.039401 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:27:03.039491 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.039733 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.039819 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040045 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040386 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040533 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040688 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.040774 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041002 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041095 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041318 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041419 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041633 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041733 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.041937 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042032 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042246 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042339 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042555 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042640 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042866 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.042959 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.043266 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.043746 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.043834 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044056 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044155 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044370 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044458 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044677 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044764 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.044997 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045092 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045325 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045412 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045636 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045772 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.045958 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046054 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046262 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046346 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046572 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046655 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046880 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.046978 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047190 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047276 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047521 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047608 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047832 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.047935 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048143 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048241 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048445 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048540 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048769 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.048857 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049079 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049172 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049384 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049475 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049691 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049786 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.049996 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050091 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050297 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050392 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050612 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050700 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.050916 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051008 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051224 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051346 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051556 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051658 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051867 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.051966 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052169 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052265 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052475 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052561 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052786 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.052872 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053113 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053206 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053425 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053513 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053734 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.053826 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054038 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054132 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054351 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054437 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054655 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054741 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.054960 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055057 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055265 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055425 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055587 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055689 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.055890 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056000 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056188 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056273 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056492 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056576 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056792 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.056879 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057094 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057180 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057400 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057487 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057701 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.057789 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.058005 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.058093 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.058311 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.058395 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.058617 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.059246 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.059503 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.059826 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060010 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060109 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060450 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060648 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060756 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.060967 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.061100 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.061281 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.061434 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.061590 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062016 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062176 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062340 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062490 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062652 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062799 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.062968 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063123 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063278 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063458 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063616 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063762 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.063930 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064077 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064241 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064388 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064561 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064697 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.064873 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065008 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065192 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065316 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065502 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065638 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065826 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.065935 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066138 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066237 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066454 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066564 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066759 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.066892 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067077 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067195 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067440 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067774 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.067874 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068091 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068186 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068505 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068723 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.068810 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069021 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069106 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069321 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069414 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069620 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069707 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.069924 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070010 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070222 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070308 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070521 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070608 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070822 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.070908 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071122 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071214 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071442 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071531 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071761 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.071868 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072065 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072161 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072364 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072449 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072666 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.072939 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073032 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073243 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073330 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073667 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073883 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.073969 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.074200 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.074286 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.075124 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.075545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.075635 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.075862 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.075963 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076181 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076307 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076489 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076593 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076798 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.076913 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077109 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077214 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077420 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077519 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077729 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.077834 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078037 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078135 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078338 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078443 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078648 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078745 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.078954 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079051 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079259 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079379 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079587 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079678 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079892 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.079980 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080210 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080309 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080513 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080602 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080825 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.080920 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081144 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081241 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081449 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081547 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081758 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.081907 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082060 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082217 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082352 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082488 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082659 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082791 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.082962 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083107 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083250 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083362 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083588 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083725 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083894 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.083996 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084207 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084339 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084515 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084646 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084827 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.084962 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085130 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085265 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085443 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085576 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085744 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.085879 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086051 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086185 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086392 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086535 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086682 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086827 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.086960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087099 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087260 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087410 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087587 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087675 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087894 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.087980 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088202 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088295 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088503 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088588 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088807 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.088902 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089111 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089281 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089409 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089496 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089708 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.089800 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.090098 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.090211 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.090497 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.090882 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091068 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091196 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091426 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091535 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091744 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.091841 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092065 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092205 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092386 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092478 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092699 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.092792 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093001 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093094 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093309 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093397 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093626 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093711 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.093938 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094034 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094252 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094349 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094558 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094645 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094855 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.094946 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095156 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095256 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095499 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095586 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095795 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.095880 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096095 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096193 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096398 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096518 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096700 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.096801 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097003 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097113 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097310 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097410 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097616 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097720 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.097929 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098027 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098233 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098333 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098537 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098633 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098840 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.098945 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099145 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099257 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099474 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099573 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099778 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.099876 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100084 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100182 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100388 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100487 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100696 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.100795 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101003 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101111 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101308 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101417 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101614 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101712 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.101936 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102046 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102244 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102343 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102552 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102691 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102859 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.102949 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103161 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103328 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103496 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103627 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103798 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.103932 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104107 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104349 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104491 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104679 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104815 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.104992 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105136 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105298 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105432 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105640 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105830 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.105964 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.106252 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.106563 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.106711 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.106853 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.106988 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107328 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107486 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107620 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107790 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.107939 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108075 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108216 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108385 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108532 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108694 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108830 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.108994 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109298 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109438 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109597 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109731 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.109900 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110042 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110202 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110336 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110503 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110636 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110800 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.110945 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111100 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111234 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111425 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111560 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111728 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.111872 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112013 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112165 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112314 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112449 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112612 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112754 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.112924 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113065 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113230 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113364 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113576 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113719 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113852 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.113984 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114119 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114261 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114401 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114487 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114719 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.114806 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115021 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115116 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115350 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115441 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115656 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115754 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.115960 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116047 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116262 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116350 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116569 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116712 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116871 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.116968 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117170 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117257 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117470 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117554 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117771 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.117865 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118073 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118159 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118373 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118458 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118679 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118772 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.118979 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119063 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119280 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119404 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119603 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119699 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119900 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.119984 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120204 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120297 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120504 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120598 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120888 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.120986 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.121708 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.121803 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122052 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122365 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122451 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122680 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122857 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.122989 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123133 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123302 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123439 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123624 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123755 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.123937 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124087 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124223 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124351 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124540 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124671 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124841 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.124972 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125145 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125276 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125447 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125578 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125755 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.125898 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126057 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126185 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126358 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126488 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126679 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126765 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.126983 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127122 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127282 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127461 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127610 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127746 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.127879 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128018 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128182 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128331 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128466 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128600 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128774 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.128922 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129089 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129232 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129398 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129532 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129698 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.129828 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130002 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130151 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130286 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130419 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130590 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130726 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.130889 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131033 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131194 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131347 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131516 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131645 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131815 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.131947 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132112 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132247 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132410 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132500 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132707 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.132802 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133013 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133106 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133314 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133399 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133614 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133736 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.133914 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134047 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134215 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134357 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134550 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134666 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134850 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.134975 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.135201 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.135346 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.135615 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.135781 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.135930 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.136099 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.136234 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.136415 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.136648 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.136735 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.137535 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.137851 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138165 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138343 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138472 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138676 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138763 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.138987 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139073 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139341 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139464 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139659 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139763 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.139977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140076 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140283 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140384 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140587 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140693 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.140899 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141005 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141207 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141306 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141516 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141613 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141834 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.141942 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142154 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142252 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142472 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142614 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142770 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.142924 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143075 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143235 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143405 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143589 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143710 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.143913 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144003 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144238 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144325 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144547 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144680 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144865 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.144952 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145175 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145270 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145492 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145586 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145798 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.145890 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146099 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146185 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146405 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146501 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146708 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.146794 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147006 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147141 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147344 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147448 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147652 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147739 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.147951 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148038 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148253 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148374 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148554 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148698 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.148859 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149009 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149158 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149331 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149576 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149663 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149882 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.149968 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150186 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150273 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150486 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150572 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150792 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.150887 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151097 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151189 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151426 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151515 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151735 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.151834 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152035 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152142 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152342 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152470 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152677 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.152981 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.153216 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.153312 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.153535 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.153622 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.153851 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154003 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154142 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154352 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154495 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154628 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154743 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.154912 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155069 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155214 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155396 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155528 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155700 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155862 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.155998 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156144 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156305 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156440 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156607 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156743 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.156908 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157051 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157250 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157386 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157694 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.157881 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158020 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158212 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158354 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158537 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158674 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158848 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.158985 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159180 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159350 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159521 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159651 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159837 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.159990 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160126 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160257 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160432 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160576 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160737 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.160873 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161051 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161187 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161360 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161508 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161647 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161791 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.161956 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162090 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162253 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162397 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162558 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162708 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.162864 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163001 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163132 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163276 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163473 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163604 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163793 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.163937 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164085 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164229 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164403 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164710 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.164817 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165014 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165148 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165319 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165458 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165622 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165774 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.165962 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166094 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166260 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166395 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166561 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166700 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.166877 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167009 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167177 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167366 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167498 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167645 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167791 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.167925 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.168117 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.168251 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.168625 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.168940 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169081 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169251 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169388 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169567 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169701 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.169873 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170020 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170188 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170323 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170501 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170636 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170810 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.170945 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171126 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171270 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171457 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171598 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171773 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.171908 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172077 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172290 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172423 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172618 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172723 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.172933 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173066 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173246 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173346 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173558 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173814 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.173901 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174139 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174225 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174464 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174562 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174776 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.174863 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175085 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175173 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175418 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175521 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175747 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.175834 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176055 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176142 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176369 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176457 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176686 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176773 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.176985 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177072 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177284 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177408 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177589 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177676 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177888 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.177984 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178187 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178274 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178485 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178571 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178787 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.178883 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179086 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179173 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179416 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179517 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179716 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.179804 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180034 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180121 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180428 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180653 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180741 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.180958 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181052 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181258 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181345 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181560 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181648 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181859 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.181946 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182175 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182269 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182483 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182576 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182812 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.182899 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.183124 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.183371 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.183470 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.183611 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.184296 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.184620 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.184852 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185143 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185232 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185459 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185546 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185793 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.185881 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.186104 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.186199 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.186419 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.186506 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.186985 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187078 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187327 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187431 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187627 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187717 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.187939 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188035 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188245 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188333 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188554 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188641 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188863 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.188958 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.189169 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.189263 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.189491 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.189679 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.189804 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190005 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190109 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190314 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190432 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190623 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190750 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.190933 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191242 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191346 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191575 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191665 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191882 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.191972 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192189 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192277 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192495 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192590 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192800 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.192889 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193124 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193222 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193443 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193534 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193764 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.193861 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194070 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194158 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194388 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194487 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194697 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.194783 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195001 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195087 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195331 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195438 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195640 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195727 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.195950 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196037 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196254 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196343 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196564 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196650 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196866 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.196952 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197174 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197262 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197483 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197605 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197786 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.197873 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198090 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198179 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198397 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198482 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198699 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.198784 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.199002 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.199088 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.199347 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.199437 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.200277 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.200601 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.200689 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.200909 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.200997 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201220 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201308 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201526 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201614 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201841 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.201934 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.202145 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.202232 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.202454 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.202548 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.202800 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203067 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203168 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203336 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203479 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203670 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203765 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.203992 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204079 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204313 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204401 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204626 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204712 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.204942 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205037 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205252 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205339 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205558 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205650 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205859 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.205945 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.206165 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.206417 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.206504 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.206765 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.206854 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207067 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207164 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207398 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207499 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207700 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.207786 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208013 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208101 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208315 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208409 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208627 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208842 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.208939 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209189 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209278 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209505 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209591 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209829 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.209930 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210136 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210221 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210451 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210754 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.210840 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211058 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211151 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211388 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211479 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211691 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211782 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.211995 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212081 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212299 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212385 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212598 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212687 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212897 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.212984 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213204 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213303 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213506 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213595 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213802 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.213889 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214105 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214272 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214403 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214491 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214722 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.214809 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.215048 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.215152 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.215387 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.215699 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.215869 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216008 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216182 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216322 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216495 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216648 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.216948 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217034 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217253 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217347 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217557 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217664 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217865 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.217989 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218240 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218345 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218542 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218635 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218851 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.218951 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219155 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219255 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219489 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219593 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219791 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.219882 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220099 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220191 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220414 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220515 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220743 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.220848 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221044 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221134 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221345 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221434 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221658 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221756 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.221965 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222062 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222283 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222371 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222586 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222689 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222892 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.222987 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.223206 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.223321 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.223543 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.223649 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.223846 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224075 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224167 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224407 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224512 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224726 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.224815 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225028 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225117 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225332 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225430 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225634 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225723 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.225940 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226029 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226240 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226338 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226542 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226632 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226842 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.226931 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227141 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227234 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227465 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227558 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227768 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.227870 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228075 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228176 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228373 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228461 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228673 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228770 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.228972 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229071 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229273 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229362 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229571 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229661 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229875 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.229965 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.230181 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.230270 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.230490 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.231151 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.231477 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.231797 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.231897 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232116 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232204 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232473 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232569 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232750 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.232838 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233072 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233158 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233390 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233503 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233698 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.233797 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234005 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234115 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234312 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234620 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234720 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.234926 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235032 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235236 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235362 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235568 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235660 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235875 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.235979 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236194 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236283 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236517 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236605 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236822 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.236913 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237144 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237234 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237459 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237551 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237779 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.237871 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238149 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238252 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238394 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238490 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238712 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.238803 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239018 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239107 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239345 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239455 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239656 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239754 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.239966 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240062 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240275 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240380 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240591 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240756 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.240891 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241027 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241162 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241305 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241464 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241608 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241778 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.241915 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242085 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242240 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242376 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242509 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242670 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.242813 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243020 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243165 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243364 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243525 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243658 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.243811 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244015 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244154 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244304 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244439 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244574 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244708 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.244850 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245005 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245135 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245277 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245413 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245553 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245696 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.245827 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:27:03.245959 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.247314 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.247646 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.247958 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.248266 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.248572 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.248877 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.249180 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.249511 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.249841 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.250154 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.250477 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.250788 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.251106 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.251442 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.251762 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.252081 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.252395 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.252702 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.253030 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.253339 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.253649 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.253956 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.254262 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.254568 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.254874 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.255194 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.255540 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.255845 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.256170 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.256484 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.256802 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.257113 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.257422 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.257747 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.258056 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.258363 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.258669 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.258977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.259302 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.259615 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.259922 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.260229 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.260541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.260851 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.261174 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.261495 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.261800 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.265150 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.265516 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.265893 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.266233 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.266600 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.266945 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.267271 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.267615 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.267931 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:27:03.268179 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:27:03.307715 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Registered counter for database nova_api Jul 20 09:27:03.333249 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Registered counter for database nova_api Jul 20 09:27:03.420244 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.426960 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.449040 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.456118 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.483560 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.context [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8680c429-cc49-4148-b6dc-1e5278bfc5a0(cell1) {{(pid=103408) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:27:03.487471 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:03.489072 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:03.489852 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:03.491985 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:03.493955 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Registered counter for database nova_cell0 Jul 20 09:27:03.498383 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Registered counter for database nova_cell1 Jul 20 09:27:03.505675 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.507343 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.513110 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.514668 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.context [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8680c429-cc49-4148-b6dc-1e5278bfc5a0(cell1) {{(pid=103407) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:27:03.518147 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.518694 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:03.520323 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:03.521104 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:03.523175 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:03.525195 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Registered counter for database nova_cell0 Jul 20 09:27:03.529553 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Registered counter for database nova_cell1 Jul 20 09:27:03.536981 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.539199 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.545283 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.550307 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.661800 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Registered counter for database nova_cell0 Jul 20 09:27:03.669225 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.673695 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:03.698121 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Registered counter for database nova_cell0 Jul 20 09:27:03.707978 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:27:03.712367 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:27:04.012685 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:27:04.019954 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:27:04.037595 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:27:04.045882 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:27:04.369070 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:27:04.375596 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:27:04.380836 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4a3bd09c0 pid: 103408 (default app) Jul 20 09:27:04.382904 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:04.384116 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 Jul 20 09:27:04.384538 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Wed Jul 20 09:27:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:27:04.399694 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:27:04.405711 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-1b21d615-baad-4646-b1ff-d5932c50ca38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:27:04.410978 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4a3bd09c0 pid: 103407 (default app) Jul 20 09:28:20.502042 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:20.503768 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jul 20 09:28:20.504377 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:20.516389 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:20.518021 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:20.518874 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:20.519953 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:21.379102 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-bfd4440e-e5f2-41a9-813e-aab4aaf13ea1 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:21.409735 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-bfd4440e-e5f2-41a9-813e-aab4aaf13ea1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898769 Jul 20 09:28:21.410868 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 20 09:28:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:28:23.646965 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:23.648093 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0c22f5bc-4360-4183-94d3-d6dfc6d47139 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 20 09:28:23.648781 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:24.122946 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-cc67c874-01ca-4a42-9181-a6871ee89268 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:24.141627 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:28:24.141627 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 20 09:28:24.173493 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-cc67c874-01ca-4a42-9181-a6871ee89268 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518758 Jul 20 09:28:24.181076 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:24.187642 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:24.189530 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:24.190465 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:24.191653 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:24.398175 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-a19927f8-ad03-48e9-93cf-509794b184a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:24.400646 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:28:24.400646 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:28:24.474544 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-a19927f8-ad03-48e9-93cf-509794b184a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292228 Jul 20 09:28:24.475403 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 20 09:28:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:26.768637 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-cc67c874-01ca-4a42-9181-a6871ee89268 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:26.769670 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-cc67c874-01ca-4a42-9181-a6871ee89268 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 20 09:28:26.771395 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:27.435868 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-76008abe-072d-4841-a379-c91272b2b3cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:27.458142 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:28:27.458142 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:28:27.476859 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-76008abe-072d-4841-a379-c91272b2b3cf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700464 Jul 20 09:28:27.477628 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:27.489896 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-afbd0f17-6db8-4ba1-8d08-21fb0879e375 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:27.491425 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:28:27.491425 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 20 09:28:27.527993 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-afbd0f17-6db8-4ba1-8d08-21fb0879e375 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042320 Jul 20 09:28:27.528624 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 20 09:28:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:28:29.820952 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-76008abe-072d-4841-a379-c91272b2b3cf admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:29.822078 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-76008abe-072d-4841-a379-c91272b2b3cf admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 20 09:28:29.826953 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:30.242801 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ba634e40-8249-476a-92c5-5356aef3013b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:30.261057 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ba634e40-8249-476a-92c5-5356aef3013b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432576 Jul 20 09:28:30.261947 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:30.274325 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8adddfde-531b-44e1-8386-f5095e71a6bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:30.297835 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-8adddfde-531b-44e1-8386-f5095e71a6bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027511 Jul 20 09:28:30.298927 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 20 09:28:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:28:32.540695 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ba634e40-8249-476a-92c5-5356aef3013b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:32.541930 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ba634e40-8249-476a-92c5-5356aef3013b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Jul 20 09:28:32.542935 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:32.963056 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-38e30cf5-0a8e-4760-bb02-793b6f36e8c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:32.992899 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-38e30cf5-0a8e-4760-bb02-793b6f36e8c8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444335 Jul 20 09:28:32.993452 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:28:33.005491 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e1ba963e-4e81-436d-9c3f-284afb83ec57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:33.036227 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e1ba963e-4e81-436d-9c3f-284afb83ec57 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030432 Jul 20 09:28:33.042999 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 20 09:28:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:35.299635 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-38e30cf5-0a8e-4760-bb02-793b6f36e8c8 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:35.300650 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-38e30cf5-0a8e-4760-bb02-793b6f36e8c8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 09:28:35.301047 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:35.743653 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "ram": 4096}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:35.761604 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454689 Jul 20 09:28:35.762355 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:28:35.773852 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0efcd170-c752-4cd2-b591-ebfa81f00875 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:35.796673 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0efcd170-c752-4cd2-b591-ebfa81f00875 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026424 Jul 20 09:28:35.797246 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Wed Jul 20 09:28:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:38.059566 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:38.060579 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 20 09:28:38.061235 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:38.471545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c8ae7c43-8087-4c60-bce0-59973fee1ca7 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:38.494561 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c8ae7c43-8087-4c60-bce0-59973fee1ca7 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.427431 Jul 20 09:28:38.495100 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 20 09:28:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:28:41.058276 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:41.059346 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-797a43f3-89c5-46b3-9775-dcc290cf2f14 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 20 09:28:41.059748 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:28:41.503535 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b2d7ba2d-3805-4feb-9112-cb291c5f29ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:41.532205 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b2d7ba2d-3805-4feb-9112-cb291c5f29ca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.465292 Jul 20 09:28:41.533327 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:41.545580 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ca3bfe7c-7ce0-480b-9453-5a3f025aa5ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:41.577715 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ca3bfe7c-7ce0-480b-9453-5a3f025aa5ce admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034875 Jul 20 09:28:41.579272 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 20 09:28:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:43.977693 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b2d7ba2d-3805-4feb-9112-cb291c5f29ca admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:43.978712 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b2d7ba2d-3805-4feb-9112-cb291c5f29ca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 09:28:43.979116 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:44.366493 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b7a662cd-4431-41be-b724-d1f8a960a747 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "id": "2", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:44.386065 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b7a662cd-4431-41be-b724-d1f8a960a747 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.401345 Jul 20 09:28:44.386760 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:28:44.399247 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c6a89e3a-d770-49fa-8a53-9ce30c84234f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:44.421376 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c6a89e3a-d770-49fa-8a53-9ce30c84234f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025858 Jul 20 09:28:44.421953 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 20 09:28:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:28:46.663922 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b7a662cd-4431-41be-b724-d1f8a960a747 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:46.665512 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b7a662cd-4431-41be-b724-d1f8a960a747 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002324 Jul 20 09:28:46.665914 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:47.061730 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0f335e15-85a9-4f6f-bd0e-3cdc4452b3ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:47.080321 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0f335e15-85a9-4f6f-bd0e-3cdc4452b3ba admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.408287 Jul 20 09:28:47.081000 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:47.092845 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-3889eb65-cd1e-4075-aacd-b54d4d2c4f91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:47.119009 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-3889eb65-cd1e-4075-aacd-b54d4d2c4f91 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029852 Jul 20 09:28:47.119917 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 20 09:28:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:49.454601 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0f335e15-85a9-4f6f-bd0e-3cdc4452b3ba admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:49.455673 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0f335e15-85a9-4f6f-bd0e-3cdc4452b3ba admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 20 09:28:49.456822 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:49.920576 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-396c4aab-0fca-46f8-af39-f9a7818b3f7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "swap": 0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:49.944008 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-396c4aab-0fca-46f8-af39-f9a7818b3f7b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480612 Jul 20 09:28:49.944875 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:49.958119 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-a1500dd8-7eb3-4a83-bb3d-5503604f0e96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:49.982688 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-a1500dd8-7eb3-4a83-bb3d-5503604f0e96 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029134 Jul 20 09:28:49.985100 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 20 09:28:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:28:52.282531 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-396c4aab-0fca-46f8-af39-f9a7818b3f7b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:28:52.283620 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-396c4aab-0fca-46f8-af39-f9a7818b3f7b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 20 09:28:52.284367 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:52.742099 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:52.761289 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470034 Jul 20 09:28:52.761964 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Wed Jul 20 09:28:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:28:52.773981 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-40c14c21-b9cb-41dd-8e97-ea5212e48015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:28:52.778712 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:28:52.802972 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-40c14c21-b9cb-41dd-8e97-ea5212e48015 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032637 Jul 20 09:28:52.807651 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Wed Jul 20 09:28:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:12.828214 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:12.829213 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 20 09:29:12.829605 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:13.220200 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-966aee56-a604-4deb-82f8-183ab8fd5dbe admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:13.238562 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-966aee56-a604-4deb-82f8-183ab8fd5dbe admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402413 Jul 20 09:29:13.239147 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 20 09:29:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:14.310646 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:14.311771 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-91bf9577-12f0-469a-8163-0e39287ef2e5 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 20 09:29:14.312169 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:14.827787 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-9b5b2fce-78c4-4a50-a412-f5a78de92c53 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:14.834061 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-9b5b2fce-78c4-4a50-a412-f5a78de92c53 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-9b5b2fce-78c4-4a50-a412-f5a78de92c53 admin admin] Request method failure captured: Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.18 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi18rqp9j2oakKdecB5Mq_Po-mYKk0GPl_4u3O1THi9gd1f5_PkoJHes_wZcaQEoeJw1iwHA0q5m4J4DSrd9-r1wkjiSVDL7a-Tw6Pb7LcYdym107lJLQgKf4tgFO4PG-s6A-D9RPUpHkVAS-0Lme_N9cWHZPVAGAJ02VY51PyhstijQA Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member Jul 20 09:29:14.837334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: method: > Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: exception: Flavor 42 could not be found. Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '42'} Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:14.839023 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:14.839960 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.841129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-9b5b2fce-78c4-4a50-a412-f5a78de92c53 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:14.842409 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-9b5b2fce-78c4-4a50-a412-f5a78de92c53 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387992 Jul 20 09:29:14.842409 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 20 09:29:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:14.849010 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-b07080e2-94ef-4ec1-ad4f-02bb6379581d admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:14.851999 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:14.872285 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-b07080e2-94ef-4ec1-ad4f-02bb6379581d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027310 Jul 20 09:29:14.872830 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:14.883169 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-8a46feba-1e96-4147-9bb5-76ce4dfef4de admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:14.904890 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-8a46feba-1e96-4147-9bb5-76ce4dfef4de admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025302 Jul 20 09:29:14.905422 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:14.915403 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-659c5880-e5b5-4930-812c-6d7750d3db18 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:14.921860 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-659c5880-e5b5-4930-812c-6d7750d3db18 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-659c5880-e5b5-4930-812c-6d7750d3db18 admin admin] Request method failure captured: Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.18 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi18rqp9j2oakKdecB5Mq_Po-mYKk0GPl_4u3O1THi9gd1f5_PkoJHes_wZcaQEoeJw1iwHA0q5m4J4DSrd9-r1wkjiSVDL7a-Tw6Pb7LcYdym107lJLQgKf4tgFO4PG-s6A-D9RPUpHkVAS-0Lme_N9cWHZPVAGAJ02VY51PyhstijQA Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Role: reader,admin,member Jul 20 09:29:14.925102 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Roles: reader,admin,member Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: method: > Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: exception: Flavor 42 could not be found. Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '42'} Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:14.926545 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:14.927520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:14.928897 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-659c5880-e5b5-4930-812c-6d7750d3db18 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:14.930144 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-659c5880-e5b5-4930-812c-6d7750d3db18 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015240 Jul 20 09:29:14.930144 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 20 09:29:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 09:29:15.895739 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-8a46feba-1e96-4147-9bb5-76ce4dfef4de admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:15.896755 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-8a46feba-1e96-4147-9bb5-76ce4dfef4de admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 20 09:29:15.897178 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:16.415541 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8aef9910-838a-4864-8990-9ae116d71396 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:16.420909 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-8aef9910-838a-4864-8990-9ae116d71396 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8aef9910-838a-4864-8990-9ae116d71396 admin admin] Request method failure captured: Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.18 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi18rr7e6PbjFasbfj6_10erBgpUZ9owl5J2dmcG-l9MQPX_ftiLBUg2DOefz_Fi4cVoJAI_yeGfX-WSWZM93faBlEMlpSqox9HWTXZmBkYMkjh1kUV0opbYzr_uWD95PogWkhQIhaPdrT7vRs8TemkwGHweYxDOAdSFkcz5VoS1CLJV4 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Role: reader,admin,member Jul 20 09:29:16.422412 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Roles: reader,admin,member Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: method: > Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: exception: Flavor 84 could not be found. Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '84'} Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:16.424348 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:16.425150 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.426495 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8aef9910-838a-4864-8990-9ae116d71396 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:16.427770 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-8aef9910-838a-4864-8990-9ae116d71396 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389527 Jul 20 09:29:16.427770 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 20 09:29:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:16.434137 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-590a4889-f6c4-4d9f-a39d-8805b617b0f9 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:16.456391 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-590a4889-f6c4-4d9f-a39d-8805b617b0f9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019721 Jul 20 09:29:16.456391 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:16.461681 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e48dee15-14ba-4f56-87f6-a136e7b9f0d9 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:16.476153 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-e48dee15-14ba-4f56-87f6-a136e7b9f0d9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018022 Jul 20 09:29:16.476687 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:16.486624 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b078a785-40a4-431d-9b89-7a9ae31eecd3 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:16.492039 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-b078a785-40a4-431d-9b89-7a9ae31eecd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b078a785-40a4-431d-9b89-7a9ae31eecd3 admin admin] Request method failure captured: Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.18 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi18rr7e6PbjFasbfj6_10erBgpUZ9owl5J2dmcG-l9MQPX_ftiLBUg2DOefz_Fi4cVoJAI_yeGfX-WSWZM93faBlEMlpSqox9HWTXZmBkYMkjh1kUV0opbYzr_uWD95PogWkhQIhaPdrT7vRs8TemkwGHweYxDOAdSFkcz5VoS1CLJV4 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member Jul 20 09:29:16.493539 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: method: > Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: exception: Flavor 84 could not be found. Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '84'} Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:16.495079 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:16.495977 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:16.497129 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-b078a785-40a4-431d-9b89-7a9ae31eecd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:16.498300 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-b078a785-40a4-431d-9b89-7a9ae31eecd3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012402 Jul 20 09:29:16.498300 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Wed Jul 20 09:29:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 09:29:17.479729 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e48dee15-14ba-4f56-87f6-a136e7b9f0d9 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:17.480742 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-e48dee15-14ba-4f56-87f6-a136e7b9f0d9 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 20 09:29:17.481142 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:18.008523 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-3bcdd316-c3d1-49bf-ad20-3a5171db4b56 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:18.014249 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-3bcdd316-c3d1-49bf-ad20-3a5171db4b56 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-3bcdd316-c3d1-49bf-ad20-3a5171db4b56 admin admin] Request method failure captured: Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.18 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABi18rtouam7mkMoFNlip0E6Q7nhte_PYKKY0NOj5zW5EivwWE-dWq4-Quc5of6Wrk53Gx9jCZeKCzGGzIDAEykg29T-Vxp9hCxWCj0Bw4ZrSvO55X7dOiFFP89SfGQQFL-Ix1CZ_lAxTCFUcltg-3ZqreFEvGZonJw_zR2L3Wfo4kmUuw Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Role: reader,admin,member Jul 20 09:29:18.015969 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Roles: reader,admin,member Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: method: > Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: exception: Flavor 451 could not be found. Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '451'} Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:18.017541 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:18.018581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.020291 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-3bcdd316-c3d1-49bf-ad20-3a5171db4b56 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:18.021581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-3bcdd316-c3d1-49bf-ad20-3a5171db4b56 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392167 Jul 20 09:29:18.021581 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:29:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:18.027114 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-932979db-5156-436a-990c-4b31a77adb53 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:18.041135 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-932979db-5156-436a-990c-4b31a77adb53 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017555 Jul 20 09:29:18.041645 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:29:18.051682 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:18.066583 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018734 Jul 20 09:29:18.067101 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Wed Jul 20 09:29:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:29:18.076516 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-be6baad1-fe7f-4ead-94e0-cba1bea963d1 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:18.081971 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-be6baad1-fe7f-4ead-94e0-cba1bea963d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-be6baad1-fe7f-4ead-94e0-cba1bea963d1 admin admin] Request method failure captured: Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.18 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABi18rtouam7mkMoFNlip0E6Q7nhte_PYKKY0NOj5zW5EivwWE-dWq4-Quc5of6Wrk53Gx9jCZeKCzGGzIDAEykg29T-Vxp9hCxWCj0Bw4ZrSvO55X7dOiFFP89SfGQQFL-Ix1CZ_lAxTCFUcltg-3ZqreFEvGZonJw_zR2L3Wfo4kmUuw Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Role: reader,admin,member Jul 20 09:29:18.083522 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Roles: reader,admin,member Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c93172815ff14813957f03bf548f6155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c93172815ff14813957f03bf548f6155"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c93172815ff14813957f03bf548f6155"}]}] Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: c93172815ff14813957f03bf548f6155 Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Id: cee8d1e7eb98438287c0fee8c54bc3cc Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: method: > Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: exception: Flavor 451 could not be found. Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '451'} Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:18.085118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:18.086204 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 20 09:29:18.087559 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-be6baad1-fe7f-4ead-94e0-cba1bea963d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:18.088853 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-be6baad1-fe7f-4ead-94e0-cba1bea963d1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011835 Jul 20 09:29:18.088853 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:29:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:29:19.060908 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:19.061937 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 20 09:29:19.062373 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:19.583398 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6eede31f-a995-455c-90d6-bb7621c412f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:19.601182 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6eede31f-a995-455c-90d6-bb7621c412f5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401363 Jul 20 09:29:19.601726 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 20 09:29:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:29:20.573074 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:20.574080 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 20 09:29:20.574477 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:21.094654 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8d826def-c256-471a-8680-b7ceb1674a86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:21.111631 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-8d826def-c256-471a-8680-b7ceb1674a86 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.398119 Jul 20 09:29:21.112166 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 20 09:29:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:29:22.082045 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:22.083050 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 20 09:29:22.083484 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:22.610347 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-06229649-eae7-4292-8977-a4ba6316faa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:22.628827 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-06229649-eae7-4292-8977-a4ba6316faa0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398750 Jul 20 09:29:22.629385 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 20 09:29:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:29:23.596155 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:23.597162 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 20 09:29:23.597552 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:24.116209 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-96ac5265-21c7-4352-80c7-b49b6d13902b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:24.135492 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-96ac5265-21c7-4352-80c7-b49b6d13902b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399914 Jul 20 09:29:24.136034 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Wed Jul 20 09:29:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:29:25.111622 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:25.112633 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 20 09:29:25.113025 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:25.635438 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c8304ab7-8edc-4ea4-9c87-b5e3095cf23c admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:25.654981 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c8304ab7-8edc-4ea4-9c87-b5e3095cf23c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403772 Jul 20 09:29:25.655473 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Wed Jul 20 09:29:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:30:17.820424 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:17.821448 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-dc7149c1-a493-4ed9-8c5e-988e112fb9fa admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 20 09:30:17.822039 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Wed Jul 20 09:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:30:17.832873 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:18.227449 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-6d2d08b4-d774-4c95-9b69-c2004c6bd8e9 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:18.247677 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-6d2d08b4-d774-4c95-9b69-c2004c6bd8e9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419179 Jul 20 09:30:18.248219 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Wed Jul 20 09:30:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:30:18.273483 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-170f5248-d225-4e27-8f2c-c4a2756c5ac4 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:18.276919 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:30:18.282398 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-170f5248-d225-4e27-8f2c-c4a2756c5ac4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014246 Jul 20 09:30:18.282935 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jul 20 09:30:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:30:18.294924 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-2d7a4715-9d33-4cb1-a943-9dfefdda95c2 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:18.303052 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-2d7a4715-9d33-4cb1-a943-9dfefdda95c2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011698 Jul 20 09:30:18.303621 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jul 20 09:30:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:30:18.315762 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:18.325645 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012488 Jul 20 09:30:18.326136 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Wed Jul 20 09:30:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:30:18.337671 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-11bb200d-890a-47d2-8019-92c56053c575 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:30:18.345386 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-11bb200d-890a-47d2-8019-92c56053c575 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011201 Jul 20 09:30:18.346070 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Wed Jul 20 09:30:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:33:41.361819 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:41.362865 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 20 09:33:41.363266 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:33:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:33:41.508198 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=6 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:33:41.667267 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:41.668497 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:33:41.668497 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:33:41.669711 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:41.670148 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:41.670923 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:41.671401 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:41.705520 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-367343f7-4374-4037-9da1-93c85a93978f admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199386 Jul 20 09:33:41.706008 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:33:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:33:42.539452 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:42.540436 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 20 09:33:42.540844 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:33:42.732595 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:42.733887 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:33:42.733887 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:33:42.735353 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:42.735940 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:42.736727 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:42.737152 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:42.758118 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-8da511dd-e883-4b6f-9714-60c41ee8538c admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080156 Jul 20 09:33:42.758687 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:33:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:33:53.983332 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:53.984334 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 20 09:33:53.984722 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:33:54.130292 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:33:54.131005 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:33:54.131713 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=8 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:33:54.179856 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:54.181019 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:33:54.181019 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:33:54.182187 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:54.182620 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:54.183436 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:54.183873 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:54.209468 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-9567689b-9d15-457b-a2df-d70c992caee3 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083590 Jul 20 09:33:54.209954 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:33:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:33:55.042280 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:55.043299 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-f41930fb-3696-49fc-8177-375655cbf8b8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 20 09:33:55.043715 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Wed Jul 20 09:33:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:33:55.237405 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:33:55.238661 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:33:55.238661 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 20 09:33:55.240049 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:55.240562 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:55.241511 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:33:55.241927 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:33:55.264127 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-7d559d96-4212-4072-a1b3-baa619468ff3 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080009 Jul 20 09:33:55.264697 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Wed Jul 20 09:33:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:34:52.713061 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: Wed Jul 20 09:34:52 2022 - graceful shutdown triggered... Jul 20 09:34:52.713585 dv-cinder-822822-3-iscsi devstack@n-api.service[103407]: Gracefully killing worker 1 (pid: 103407)... Jul 20 09:34:52.715203 dv-cinder-822822-3-iscsi devstack@n-api.service[103408]: Gracefully killing worker 2 (pid: 103408)... Jul 20 09:34:52.715693 dv-cinder-822822-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 09:34:53.714286 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: worker 1 buried after 1 seconds Jul 20 09:34:53.714286 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: worker 2 buried after 1 seconds Jul 20 09:34:53.714286 dv-cinder-822822-3-iscsi devstack@n-api.service[103406]: goodbye to uWSGI. Jul 20 09:34:53.715873 dv-cinder-822822-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 09:34:53.716422 dv-cinder-822822-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 09:34:53.719237 dv-cinder-822822-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 09:34:53.729035 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 09:34:53.731650 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 09:34:53 2022] *** Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: nodename: dv-cinder-822822-3-iscsi Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: machine: x86_64 Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: clock source: unix Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: pcre jit disabled Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: detected number of CPU cores: 4 Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: current working directory: / Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: detected binary path: /usr/bin/uwsgi-core Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: your processes number limit is 47680 Jul 20 09:34:53.731832 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: your memory page size is 4096 bytes Jul 20 09:34:53.732644 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: detected max file descriptor number: 2048 Jul 20 09:34:53.732644 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: lock engine: pthread robust mutexes Jul 20 09:34:53.732644 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: thunder lock: enabled Jul 20 09:34:53.732644 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 09:34:53.732644 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 09:34:53.777502 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: Python main interpreter initialized at 0x564a1cd739c0 Jul 20 09:34:53.777502 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: python threads support enabled Jul 20 09:34:53.777502 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: your server socket listen backlog is limited to 100 connections Jul 20 09:34:53.777502 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: your mercy for graceful operations on workers is 90 seconds Jul 20 09:34:53.777961 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 09:34:53.777961 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: *** Operational MODE: preforking *** Jul 20 09:34:53.778242 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: *** uWSGI is running in multiple interpreter mode *** Jul 20 09:34:53.778242 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: spawned uWSGI master process (pid: 124358) Jul 20 09:34:53.778448 dv-cinder-822822-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 09:34:53.781381 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: spawned uWSGI worker 1 (pid: 124373, cores: 1) Jul 20 09:34:53.781381 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: spawned uWSGI worker 2 (pid: 124374, cores: 1) Jul 20 09:34:53.781381 dv-cinder-822822-3-iscsi devstack@n-api.service[124358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 09:34:54.437407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:34:54.446628 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:34:55.627546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:34:55.627546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: from cryptography.utils import int_from_bytes Jul 20 09:34:55.628207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:34:55.628207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: from cryptography.utils import int_from_bytes Jul 20 09:34:55.656593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:34:55.656593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: from cryptography.utils import int_from_bytes Jul 20 09:34:55.657179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:34:55.657179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: from cryptography.utils import int_from_bytes Jul 20 09:34:57.992854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:34:57.993433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:34:57.993648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:34:57.994013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:34:57.994268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:34:57.994654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.994980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.995318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.995641 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.995970 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.996283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.996606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.996925 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.997253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.997514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.997828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.998159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-3-iscsi {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.998482 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.998792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.999103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.999450 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:57.999759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.000082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.000392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.000892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.002467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.002792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.003115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.003493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.003816 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.004154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.004461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.004773 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.005113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.005492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.005820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-3-iscsi {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.006166 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.007107 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.007513 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.007937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.008266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.008574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.008902 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.009231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.009546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.009879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.010204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.010528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.010847 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.011150 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.011349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:34:58.011787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.011887 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:34:58.011976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.012173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.012284 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:34:58.012432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.012532 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:34:58.012705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.012813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:34:58.012962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.013909 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014052 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014222 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014499 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.014979 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015060 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015240 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.015961 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.016170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.016344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.016507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-3-iscsi {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.016701 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.016870 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017176 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017638 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.017968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018117 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018601 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018749 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.018898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.019242 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.019448 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.019605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.019758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.019909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.020975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021130 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021463 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.021982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.022134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.022276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.022418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.022569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.023320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-3-iscsi {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.023490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.023646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.023789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.023930 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024083 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024242 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.024974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.025129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.025283 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.025447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.025590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.025832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026449 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026601 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.026906 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.027855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028005 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028454 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028610 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028764 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.028917 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029537 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.029982 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030430 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030573 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030716 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.030868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031827 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.031978 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032584 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032728 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.032901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.033633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.033797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.033941 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034406 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.034848 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.035000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.035144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.035326 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.035737 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.035967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036444 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036585 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036733 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.036875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.037109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.037109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.038504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.038504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.038803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.038954 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039107 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039264 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.039914 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040218 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.040972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041136 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041288 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041735 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.041885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.042037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.042188 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.042331 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.042482 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.042634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.042777 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.042930 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.043091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.043772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.043940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.044107 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.044255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.044397 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.044643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.044793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.044944 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.045102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.045253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.045395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.045549 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.045849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.046147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.046147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.046445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.046605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.046767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.046919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.047080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.047224 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.047399 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.047544 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.047697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.047852 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.048009 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.048153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.048302 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.048444 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.048592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.048744 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.048896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.049040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.049189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.049339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.049492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.049644 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.049806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.049956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.050139 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.050295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.050447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.050590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.050739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.050890 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.051046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.051196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.051432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.051585 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.051736 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.051899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.052052 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.052195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.052344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.052493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.052493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.052772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.052924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.054232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.054399 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.054553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.054813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.054976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.055133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.055310 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.055475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.055618 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.055768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.055921 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.056093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.056315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.056464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.056614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.056764 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.056925 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.057092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.057245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.057395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.057545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.057695 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.057838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.057993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.058139 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.058139 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.058423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.058423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.058711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.058872 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.059035 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.059186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.059359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.059519 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.059662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.059816 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.059960 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.060110 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:34:58.060255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.060255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.060539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.060694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.060844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061005 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061156 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061306 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061459 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.061910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062700 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.062859 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063378 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063538 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.063857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.064504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.064669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065037 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065340 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065651 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.065953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.066102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.066244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.066474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.066625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.066866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067175 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.067970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.068118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.068268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.068410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.068561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.071987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072609 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.072926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073077 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073515 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.073953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.074122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.074768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.074925 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075531 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.075977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076667 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076823 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.076990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077298 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077887 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.077887 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.078309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.078453 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.078593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.078743 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.078895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079189 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.079994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080438 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080742 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.080886 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.081936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082230 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082534 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.082983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.083928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.084084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.084349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.085582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.085742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.085895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.086876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087032 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.087973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088429 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.088897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089602 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.089902 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.090954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091261 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.091894 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092647 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.092929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.093937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094224 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094671 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094671 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.094964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.095606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.095852 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096209 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096509 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.096808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097060 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097679 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.097971 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098421 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098564 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098713 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.098857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099017 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099407 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.099895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100211 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100513 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.100806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.101952 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102239 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102388 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102679 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.102975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.103922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.104890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.105054 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.105685 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.105870 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106112 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106511 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106821 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.106972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.107217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.107421 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.107574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.107718 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.107870 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108172 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.108919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.109939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110679 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110829 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.110980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111123 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.111913 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112368 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112676 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.112986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113452 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.113928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114732 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.114887 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.115044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.115203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.117114 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.117368 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.117554 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.117721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.117918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.118855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119831 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.119980 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.120135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.120295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.120445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.120682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.120851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121326 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121634 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.121965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.122123 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.122303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.122596 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.122753 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.122903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123059 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123443 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.123915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.124920 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.125067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.125225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.131956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133106 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133817 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.133966 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134203 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134368 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.134995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.135849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.136147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.136299 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.136501 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.136689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.136853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137016 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137595 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.137965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.139667 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.139850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140323 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.140919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.141880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.142912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.143061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.143217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.143443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.143597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.143994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.144233 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.144404 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.144557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.144713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.144863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.145012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.145175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.145701 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.146055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.146294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.146464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.146623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.146848 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147159 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.147845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.148271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.149053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.149216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.149369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150215 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150368 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150519 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150676 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.150996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151347 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.151996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152306 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152454 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152612 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.152935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.153086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.153243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.153392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.153551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.153708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.154181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.154362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.154524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.154676 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.154840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.155813 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.156450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.156614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.156614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.156921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157406 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157799 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157906 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.157990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.158071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.158198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.158292 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.158379 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.158508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159226 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159364 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.159976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160060 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.160889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161052 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.161936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162204 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162295 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162431 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162704 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.162963 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163042 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163121 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163203 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163420 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163519 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.163912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.164021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.164303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.164408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.164559 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.164661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.165615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.165841 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.165943 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166032 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166424 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166495 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166773 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.166989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167911 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.167990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168158 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168158 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168448 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168743 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.168833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169727 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.169924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170385 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.170999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171069 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171228 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171332 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171712 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.171938 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.172665 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.173365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.173518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.173671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.173803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.173975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.174969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175098 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.175960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176318 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176456 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.176923 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177125 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.177824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.178822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.178822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.179613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.179759 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.179866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180194 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180883 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.180977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181330 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181606 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.181772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182220 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182680 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182823 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.182955 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183099 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183444 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183534 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183619 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.183798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184014 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.184951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185342 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185707 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185707 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.185919 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.186967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187594 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.187962 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.188929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189861 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.189955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190201 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190292 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190746 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.190924 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191094 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191608 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191796 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.191889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192137 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192554 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192812 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.192948 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.193085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.193260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.193403 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.193533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194261 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.194908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.195976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196295 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196760 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.196931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197023 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197170 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197261 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197360 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197454 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197730 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.197915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198094 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198456 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198631 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198730 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198817 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.198995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199185 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199271 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199780 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.199958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200473 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200560 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200819 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200819 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.200982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201530 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.201964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202358 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202862 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.202955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203503 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203673 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203765 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203862 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.203962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204226 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204380 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204559 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204775 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.204868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205035 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205423 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205523 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.205976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206456 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.206959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207045 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207624 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.207970 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208769 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.208955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209149 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209419 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209984 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.209984 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210451 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210773 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.210877 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.211092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.211204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212547 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.212959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213053 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213140 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213319 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.213943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214698 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.214799 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215333 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215481 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215647 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.215951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216259 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216871 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.216978 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217172 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217583 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217807 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.217908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218136 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218442 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.218943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219063 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.219987 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220323 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220560 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220714 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.220865 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221005 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.221860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222379 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222687 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.222986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223463 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223630 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.223955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.224990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.225178 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.225348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.225528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.225869 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.225969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226194 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226286 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.226930 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227239 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.227874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228695 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.228796 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229004 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.229918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230528 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230829 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.230931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231765 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.231860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232463 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.232965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233112 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233568 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233755 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.233858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234066 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234166 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.234824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235025 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235116 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235462 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.235782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236004 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.236924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237338 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237549 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237852 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.237952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.238160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.238258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.238480 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.238572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.238790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239472 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.239995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.240082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.240321 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.240411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.241126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.241277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.241415 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.241706 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.241877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.242073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.242169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.242298 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.242464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.242602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.243706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.243862 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.243960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244069 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244166 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244817 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.244910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.245891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.246998 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247495 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247821 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.247966 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.248895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249413 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249724 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.249822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250035 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250746 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.250954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251419 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.251983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252345 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.252935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.253971 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254635 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.254957 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.255167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.255356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.255540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.255682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.255887 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.256041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.256276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.256580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.256726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.256876 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257101 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257403 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257685 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.257994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258142 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258292 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.258874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259324 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259647 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259856 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.259959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260291 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.260858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261030 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.261733 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:34:58.261935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.262234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.262536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.262837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.263137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.263461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.263794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.264124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.264436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.264757 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.265065 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.265382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.265690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.266010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.266338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.266655 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.266962 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.267306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.267629 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.267938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.268246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.268552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.268858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.269164 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.269491 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.269813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.270119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.270448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.270765 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.271084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.271522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.272262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.272731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.273308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.273734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.274053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.274368 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.274678 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.275002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.275332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.275645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.275962 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.276280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.276615 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.276941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.277251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.277577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.277901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.278255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.278569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.278927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.279243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.279586 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.279898 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.280205 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:34:58.280450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:34:58.416207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO dbcounter [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Registered counter for database nova_api Jul 20 09:34:58.435655 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO dbcounter [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Registered counter for database nova_api Jul 20 09:34:58.436229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_db.sqlalchemy.engines [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.443042 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writer thread running {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.455857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_db.sqlalchemy.engines [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.463121 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writer thread running {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.501040 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.context [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8680c429-cc49-4148-b6dc-1e5278bfc5a0(cell1) {{(pid=124374) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:34:58.505045 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:34:58.507164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:34:58.507983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:34:58.509949 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:34:58.511935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO dbcounter [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Registered counter for database nova_cell0 Jul 20 09:34:58.516017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO dbcounter [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Registered counter for database nova_cell1 Jul 20 09:34:58.520153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.context [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8680c429-cc49-4148-b6dc-1e5278bfc5a0(cell1) {{(pid=124373) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:34:58.523894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_db.sqlalchemy.engines [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.525384 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:34:58.526236 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_db.sqlalchemy.engines [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.526989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:34:58.527824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:34:58.529813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:34:58.531827 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO dbcounter [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Registered counter for database nova_cell0 Jul 20 09:34:58.533797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writer thread running {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.534221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writer thread running {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.536091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO dbcounter [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Registered counter for database nova_cell1 Jul 20 09:34:58.544119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_db.sqlalchemy.engines [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.545754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_db.sqlalchemy.engines [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.551152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writer thread running {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.556872 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writer thread running {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.679713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO dbcounter [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Registered counter for database nova_cell0 Jul 20 09:34:58.687027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_db.sqlalchemy.engines [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.691564 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writer thread running {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:58.704786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO dbcounter [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Registered counter for database nova_cell0 Jul 20 09:34:58.713067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_db.sqlalchemy.engines [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:34:58.717720 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writer thread running {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:34:59.013788 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: WARNING keystonemiddleware.auth_token [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:34:59.021106 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: WARNING keystonemiddleware.auth_token [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:34:59.041073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: WARNING keystonemiddleware.auth_token [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:34:59.048900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: WARNING keystonemiddleware.auth_token [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:34:59.365903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: WARNING keystonemiddleware.auth_token [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:34:59.371994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: WARNING keystonemiddleware.auth_token [None req-7a508417-4aa6-4f9c-b97a-4b61fcb598e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:34:59.378194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a1cd739c0 pid: 124374 (default app) Jul 20 09:34:59.401632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: WARNING keystonemiddleware.auth_token [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:34:59.407726 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: WARNING keystonemiddleware.auth_token [None req-a5db9684-9623-4497-8fe2-a22fe7f81d0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:34:59.414309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a1cd739c0 pid: 124373 (default app) Jul 20 09:35:47.414668 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:47.415775 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:47.416633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:47.417662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:48.285232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-81b853bc-7696-4470-9bdf-cdb33df1356a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: .version_select at 0x7f81f6426c10>, body: {"keypair": {"name": "tempest-keypair-2054059781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjyycxonoeZJKOMvIomIPJfLbNdibTYq/vkOMhofY19b0QuUm1U7yNE/WIUH5PyVTu98vNhlb1Xz6ZywMxYP13AH3Nv53oAZbPDqQxTgN7cM05V8Rn8xSmTCMxrlAYpug=="}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:35:48.375903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-81b853bc-7696-4470-9bdf-cdb33df1356a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for project e068f9b959004be4ad9c778d9010561a. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:35:48.383131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-81b853bc-7696-4470-9bdf-cdb33df1356a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for user ee885a29e6fa4b1980d7ae1d03b2b476 and project e068f9b959004be4ad9c778d9010561a. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:35:48.460623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-81b853bc-7696-4470-9bdf-cdb33df1356a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.057550 Jul 20 09:35:48.461314 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:35:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:35:52.167204 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:52.168833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:52.169768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:52.171834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:53.554186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6aa5f88c-9edd-44bb-a83e-f72d57cae0cf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: .version_select at 0x7f81f6425ca0>, body: {"keypair": {"name": "tempest-keypair-1287157503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4XV7nsj9FAzpCr1YfpMMfTAXxnMpYWrRcdsPE3mmQj7HLIREb4UCUcqWH/8fgfWEsEGptZxTUmxCYdoxcD49fr9ftPDotOa05xvk3lorEwYaDGtanA229udXAan3NjwQ=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:35:53.723818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6aa5f88c-9edd-44bb-a83e-f72d57cae0cf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for project 07eb1473648d490b90a1e7debc45d57d. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:35:53.761421 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6aa5f88c-9edd-44bb-a83e-f72d57cae0cf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for user a37198e6d4424a51800655d3bd0a3ee6 and project 07eb1473648d490b90a1e7debc45d57d. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:35:53.875434 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6aa5f88c-9edd-44bb-a83e-f72d57cae0cf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.729602 Jul 20 09:35:53.876733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 1/2] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jul 20 09:35:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1732 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 09:35:55.035318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1056674891", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a1bf85-9a28-4e91-952b-126a8641e41e"}], "security_groups": [{"name": "tempest-securitygroup--1738159721"}], "key_name": "tempest-keypair-2054059781", "user_data": "}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:35:56.605481 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] validate_networks() for [('36a1bf85-9a28-4e91-952b-126a8641e41e', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:35:58.101660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-205914606", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc1f444-18bf-42e0-ae56-3a62ba59289b"}], "security_groups": [{"name": "tempest-securitygroup--2137074199"}], "key_name": "tempest-keypair-1287157503", "user_data": "}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:35:58.398039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:35:59.586641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] validate_networks() for [('3bc1f444-18bf-42e0-ae56-3a62ba59289b', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:36:00.158880 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:00.159404 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:00.160025 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:00.160547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:00.161083 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:00.179460 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:00.180249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:00.182411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:00.183561 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:00.251751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for project e068f9b959004be4ad9c778d9010561a. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:00.261790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for user ee885a29e6fa4b1980d7ae1d03b2b476 and project e068f9b959004be4ad9c778d9010561a. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:00.299879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:00.308812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:00.526786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eac452a1-8a50-4a58-a601-d6c795de11d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.497813 Jul 20 09:36:00.527745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:35:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 5500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:36:00.554494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4fbe44c2-7078-4ce8-9c32-8e331ffc95ba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:00.556544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4fbe44c2-7078-4ce8-9c32-8e331ffc95ba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:00.901254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4fbe44c2-7078-4ce8-9c32-8e331ffc95ba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:00.934870 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4fbe44c2-7078-4ce8-9c32-8e331ffc95ba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1238 microversion: 2.1 time: 0.397019 Jul 20 09:36:00.936111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:00 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1238 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:02.334977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-841990380", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:02.455622 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] validate_networks() for [('b536439e-ad65-4ab6-9df1-5521403416c7', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:36:02.754436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:02.754874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:02.756096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:02.756096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:02.756096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:02.799709 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:02.800273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:02.801080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:02.801519 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:02.888596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for project 07eb1473648d490b90a1e7debc45d57d. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:02.906033 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for user a37198e6d4424a51800655d3bd0a3ee6 and project 07eb1473648d490b90a1e7debc45d57d. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:02.950691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:02.954072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:03.088117 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b322f87f-35e5-4b2c-bda8-ee6368700f1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.992556 Jul 20 09:36:03.092559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 2/5] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jul 20 09:35:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 4998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 09:36:03.109001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-83f3f343-7467-463b-978a-87fe5c0005a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:03.109764 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-83f3f343-7467-463b-978a-87fe5c0005a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:03.281614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-83f3f343-7467-463b-978a-87fe5c0005a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:03.320143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-83f3f343-7467-463b-978a-87fe5c0005a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1238 microversion: 2.1 time: 0.223516 Jul 20 09:36:03.332938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:03 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1238 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:03.687772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:03.688938 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:03.690173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:03.692538 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:03.693749 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:03.718784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:03.720960 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:03.722546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:03.725366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:03.769675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:03.776375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for user bc74ebac003a4f828fdb44db6dc42887 and project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:03.817553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:03.829103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:03.990549 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9a5dfa76-72ac-4fab-8cba-150fc6927397 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.657929 Jul 20 09:36:03.994447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 4/7] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:36:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:36:04.012833 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:04.014814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:04.214225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-120644226", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "networks": [{"uuid": "0f39ad03-6f09-42c9-9a01-67bdfcd73436"}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:04.215341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:04.233896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:04.239190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:04.241557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ace8bc35-1963-4f94-ad18-747ba17c018b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1281 microversion: 2.20 time: 0.243332 Jul 20 09:36:04.247438 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 5/8] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:03 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:04.270483 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b37e1ec7-e91c-4531-a3bf-df8aeb7e1118 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:04.275184 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b37e1ec7-e91c-4531-a3bf-df8aeb7e1118 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:04.421647 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] validate_networks() for [('0f39ad03-6f09-42c9-9a01-67bdfcd73436', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:36:04.423476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b37e1ec7-e91c-4531-a3bf-df8aeb7e1118 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:04.431981 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b37e1ec7-e91c-4531-a3bf-df8aeb7e1118 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1221 microversion: 2.1 time: 0.183234 Jul 20 09:36:04.436405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 6/9] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:04 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:04.449198 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9c342ce0-bc3d-4ee0-acc5-e5901fe812fa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:04.454185 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9c342ce0-bc3d-4ee0-acc5-e5901fe812fa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:04.629161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9c342ce0-bc3d-4ee0-acc5-e5901fe812fa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:04.637459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9c342ce0-bc3d-4ee0-acc5-e5901fe812fa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1238 microversion: 2.1 time: 0.199737 Jul 20 09:36:04.638044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 7/10] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:04 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1238 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:04.699866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1033381896", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:04.834500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] validate_networks() for [('b536439e-ad65-4ab6-9df1-5521403416c7', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:36:05.687690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:05.688291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:05.688636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:05.689116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:05.689641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:05.709046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.709845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.712252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.712711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.765093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Getting quotas for project f923122fff9b4011a092bb70c4ec6ff3. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:05.775662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Getting quotas for user a45d24d55fab4e9e852f2c65c771be17 and project f923122fff9b4011a092bb70c4ec6ff3. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:05.800702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:05.805213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:05.891122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:05.891634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:05.892049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:05.892467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:05.892883 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:05.910747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.911197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.913003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.913476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.914625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8645ebc2-4f96-481f-aea2-b644f54f0997 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.575165 Jul 20 09:36:05.916481 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 4/11] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:36:05.926924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:05.931661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:05.943017 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.943761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.945450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:05.946169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:05.960152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:05.977053 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for user bc74ebac003a4f828fdb44db6dc42887 and project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:06.001808 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:06.018531 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:06.150461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2e44ccf6-fb6d-47b4-b73b-11bf6b8e331e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.456623 Jul 20 09:36:06.151988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 8/12] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:36:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:36:06.160183 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:06.160805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:06.193991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:06.212468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:06.215524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:06.215981 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:06.260979 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.308193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.312877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.314252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7288c8a2-149c-4544-89fd-80b6cc6d8c87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1285 microversion: 2.20 time: 0.396459 Jul 20 09:36:06.314973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 5/13] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:05 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1285 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:06.349197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f326f0f1-a68d-4a45-a91f-7e5883fdabad tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:06.349831 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f326f0f1-a68d-4a45-a91f-7e5883fdabad tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:06.635183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f326f0f1-a68d-4a45-a91f-7e5883fdabad tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.647448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f326f0f1-a68d-4a45-a91f-7e5883fdabad tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1214 microversion: 2.1 time: 0.329952 Jul 20 09:36:06.650401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 6/14] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:06 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:06.664837 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.665047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c1c9ca16-7a8f-42f4-a3b5-0ee99b628fa2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:06.665789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c1c9ca16-7a8f-42f4-a3b5-0ee99b628fa2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:06.695666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f5ad8218-513f-4477-a950-bc934bf8fde2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1242 microversion: 2.1 time: 0.537945 Jul 20 09:36:06.698473 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 9/15] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:06 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1242 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:06.918104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c1c9ca16-7a8f-42f4-a3b5-0ee99b628fa2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:06.924818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c1c9ca16-7a8f-42f4-a3b5-0ee99b628fa2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1222 microversion: 2.1 time: 0.271865 Jul 20 09:36:06.928473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 7/16] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:06 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:07.336615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:07.337229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:07.346288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.346952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.347918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.348507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.419578 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:07.430393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:07.432853 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:07.434448 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ce33acae-7c9b-4d9e-82ac-e054559620d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1285 microversion: 2.20 time: 0.102452 Jul 20 09:36:07.435514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 10/17] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:07 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:07.669009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:07.669944 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:07.690622 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.691081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.691919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.692397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.714414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:07.715010 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:07.731120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.731620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.732399 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.732831 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.821723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:07.832666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a2b9b8cc-e719-44f2-8756-d84cce1a054b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1218 microversion: 2.1 time: 0.168753 Jul 20 09:36:07.835050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 8/18] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:07 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:07.864348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:07.874275 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2ea1783e-e029-46ea-ac41-00042e4a9fe3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1234 microversion: 2.1 time: 0.163610 Jul 20 09:36:07.874923 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 11/19] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:07 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1234 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:07.945884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:07.946489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:07.952396 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.952842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:07.953603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:07.954030 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.017304 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:08.025327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8233269c-a9f8-46cb-b27e-bcc14da67ec9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1226 microversion: 2.1 time: 0.083850 Jul 20 09:36:08.025970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 9/20] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:07 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:08.453870 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:08.454476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:08.460646 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.461278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.462032 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.462458 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.558439 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:08.566307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:08.569080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:08.570367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b6d8008c-dacb-4fea-ad2f-3c1cdcfa3f69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1285 microversion: 2.20 time: 0.120963 Jul 20 09:36:08.576367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 12/21] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:08 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:08.853047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:08.853915 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:08.863762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.867860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.868978 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.869295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.899564 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:08.900176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:08.907875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.908316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.909073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:08.909502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:08.995834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.006082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.008646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-48ddaf27-81d5-4ef5-9337-cbf49ba61199 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1210 microversion: 2.1 time: 0.161921 Jul 20 09:36:09.021568 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 10/22] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:08 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:09.023761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cf7e4b00-4c6c-4e70-b22a-53e4b98c50a2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1234 microversion: 2.1 time: 0.128666 Jul 20 09:36:09.024584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 13/23] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:08 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1234 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:09.042418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:09.043332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:09.049922 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:09.050474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:09.051338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:09.051858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:09.120600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.128898 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-56484ac7-1482-49c0-8470-44b2c9db83f7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1226 microversion: 2.1 time: 0.090296 Jul 20 09:36:09.129701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:09 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:09.595578 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:09.596197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:09.617118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:09.617758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:09.618652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:09.619187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:09.707359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.720266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.722477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:09.723796 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3d6ccf2d-0212-42a8-b2b0-b472c16e6f37 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1277 microversion: 2.20 time: 0.132938 Jul 20 09:36:09.725379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 14/25] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:09 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:10.030124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:10.031965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:10.042027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:10.042827 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:10.043357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.044012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.045132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.046511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.070230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.070871 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.071775 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.072275 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.178911 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.207938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e844e0bb-fe4c-423c-afef-e17fd51b9441 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1266 microversion: 2.1 time: 0.178194 Jul 20 09:36:10.226401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:10 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:10.226401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:10.227969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:10.244599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.245078 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.247645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.249092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.251742 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.264290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6f5ecc64-c877-4529-a283-b9c7656bdbec tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1290 microversion: 2.1 time: 0.225471 Jul 20 09:36:10.268637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:10 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1290 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:10.392087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.408065 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1d51f013-ed8b-4d85-9b97-46ce71236c5a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1274 microversion: 2.1 time: 0.189299 Jul 20 09:36:10.409203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 13/28] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:10 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:10.744718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:10.745345 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:10.757996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.758841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.760131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:10.760778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:10.921536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.934778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.938576 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:10.941869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c490f294-9260-40fa-938c-7932c8130684 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1333 microversion: 2.20 time: 0.202652 Jul 20 09:36:10.954825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 16/29] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:10 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1333 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:11.233999 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:11.234598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:11.241435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.242027 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.242922 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.243441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.286100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:11.287645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:11.293156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.293602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.294366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.294796 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.311654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:11.320571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-51a869c7-151e-4ecd-8834-4d82e52cffc8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1272 microversion: 2.1 time: 0.090483 Jul 20 09:36:11.321141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 14/30] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:11 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:11.371354 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:11.387076 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-28c5f5db-ef65-4877-8037-c0a5dcbc030a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1298 microversion: 2.1 time: 0.104633 Jul 20 09:36:11.388309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 17/31] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:11 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:11.426596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:11.427646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:11.438024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.438493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.439341 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.439775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.519049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:11.529693 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-91f36a69-441c-413b-9af1-2ba39b53c90b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1274 microversion: 2.1 time: 0.106875 Jul 20 09:36:11.531214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 15/32] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:11 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:11.960877 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:11.961476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:11.968744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.969190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:11.969954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:11.970464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.056958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.065659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.067188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.068574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-89a8df14-fd90-4dfb-b1e9-671fac63692f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1341 microversion: 2.20 time: 0.112376 Jul 20 09:36:12.069567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 18/33] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:11 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:12.337907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:12.338766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:12.347531 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.348005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.348758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.349899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.417117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:12.417424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:12.420341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:12.425243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.425658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.427116 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.429062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.435422 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.451620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-77283641-45c7-45ff-9657-6f789fa25973 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1272 microversion: 2.1 time: 0.116247 Jul 20 09:36:12.453967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 16/34] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:12 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:12.509459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.517949 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e1e827b8-35bb-444e-b761-266bfa05f0d1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1308 microversion: 2.1 time: 0.115889 Jul 20 09:36:12.518517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 19/35] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:12 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:12.548282 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:12.549039 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:12.557577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.558146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.559053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:12.559583 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:12.668803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:12.676960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-66354650-5f39-4ac4-8bb7-eb39608349d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1274 microversion: 2.1 time: 0.132736 Jul 20 09:36:12.677731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 17/36] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:12 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:13.091224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:13.091861 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:13.097804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.098262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.099561 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.099991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.166703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.175032 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.176579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.178940 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d5affd66-7cce-4adf-a333-e7180e8cdf03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1341 microversion: 2.20 time: 0.091056 Jul 20 09:36:13.179804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 20/37] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:13 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1341 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:13.469254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:13.469893 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:13.476674 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.477258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.478096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.478602 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.538275 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:13.539536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:13.551908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.552890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.553853 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.556289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.614099 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.626785 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0599c597-a9a8-4120-a264-2c48f5a19343 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1272 microversion: 2.1 time: 0.161484 Jul 20 09:36:13.627937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 18/38] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:13 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:13.698868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:13.699596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:13.716948 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.718833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.719739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:13.722897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:13.852846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.859469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:13.884278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fe375d51-98bf-4ee7-a5bb-b6151450a066 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1308 microversion: 2.1 time: 0.351925 Jul 20 09:36:13.885148 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9d94beaa-c0ad-46b1-9c78-9b9b56c2e059 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1282 microversion: 2.1 time: 0.193105 Jul 20 09:36:13.896846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:13 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:13.897299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 19/40] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:13 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:14.197343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:14.197942 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:14.220086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.220537 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.221314 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.221745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.373841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:14.389363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:14.391614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:14.392989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5a7c34a7-5984-498a-9ddc-f1cca39e7a25 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.200093 Jul 20 09:36:14.394909 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 22/41] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:14 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:14.651847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:14.654795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:14.670625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.671172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.683620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.683912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.836039 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:14.852091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8efe1aae-4018-46c3-8c5c-d02dbb3b93e9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1272 microversion: 2.1 time: 0.211559 Jul 20 09:36:14.855260 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 20/42] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:14 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:14.912662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:14.914216 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:14.914680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:14.918814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:14.934933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.936290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.938340 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.939570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.944918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.945418 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:14.953024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:14.953742 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:15.070413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:15.080133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-36b03617-abf0-4725-97c1-727be4441999 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.177582 Jul 20 09:36:15.087207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:15.091739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:14 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:15.115593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a9eae46d-d846-4da2-a956-41feb543d4c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.214055 Jul 20 09:36:15.117561 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 23/44] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:14 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:15.414882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:15.415863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:15.422457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:15.423017 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:15.423820 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:15.424247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:15.495711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:15.499526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:15.506503 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:15.508303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:15.509900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a2fe6d02-66d6-4c83-a5a9-57fd3723868e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.099751 Jul 20 09:36:15.510564 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:15 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:15.872735 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:15.873222 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:15.879268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:15.879739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:15.880524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:15.881135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:15.901936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:15.934831 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:15.995117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=26 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:16.034531 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.042839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6050551e-2a14-438c-b669-0d1617912aac tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.174443 Jul 20 09:36:16.043407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 24/46] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:15 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:16.097046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:16.097651 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:16.100341 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=4 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:16.106486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.106927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.107767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.108225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.133926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:16.134529 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:16.140490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.140935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.141684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.142113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.172154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.180127 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-78a7fd62-4b76-43a0-b93d-979a1544b0e7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.086861 Jul 20 09:36:16.180696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 23/47] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:16 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:16.208119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.216430 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fd344da8-1ead-4445-9404-302dc39f3b9b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.086378 Jul 20 09:36:16.217003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:16 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:16.528531 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:16.529165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:16.535102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.535579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.536451 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:16.536842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:16.608050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.621312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.622727 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:16.624542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d761bd0f-80f6-4bcb-8f35-6abb8971cb38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.099958 Jul 20 09:36:16.626088 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:16 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:17.061511 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:17.062369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:17.068846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.069625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.070632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.071131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.196385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:17.197115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:17.198836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=22 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:17.204176 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.204636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.205388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.205947 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.211632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.219372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7a049f4e-8e77-40c3-89b4-4b96f037f417 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.162852 Jul 20 09:36:17.220004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:17 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:17.234636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:17.235738 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:17.255918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.258194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.259491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.260447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.284067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.293241 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-782632d8-3e21-42f5-9421-54ba23edc9d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.100808 Jul 20 09:36:17.293907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 25/51] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:17 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:17.348449 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.356929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cfaad8ba-0455-48cb-8fea-89158e2b3733 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.127030 Jul 20 09:36:17.357763 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:17 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:17.650170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:17.651143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:17.659100 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.659825 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.660762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:17.661520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:17.777244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.785851 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.788698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:17.789901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-803a3196-dd19-4c13-95e4-3b2d48d17fc9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.145693 Jul 20 09:36:17.790522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 26/53] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:17 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:18.237366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:18.238174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:18.245479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.246326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.247251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.247891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.312549 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:18.313471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:18.318551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:18.328464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.328966 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.329904 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.330346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.424779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.439220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.439471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5a112b82-ff3f-4a6f-afcd-2c7fdb051717 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.205642 Jul 20 09:36:18.439876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:18 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:18.447328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:18.447931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:18.449937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4dc23220-d0ce-4afd-9a2d-c81b99df2979 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.143249 Jul 20 09:36:18.450913 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 27/55] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:18 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:18.463718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.464565 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.465637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.466069 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.536267 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.547331 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4d8051ed-2865-489e-9746-23fa071d9311 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.105919 Jul 20 09:36:18.551667 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:18 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:18.810613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:18.811136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:18.819217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.820009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.820741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:18.821167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:18.888499 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.901254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.902956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:18.909926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7eb9e24a-a53f-4981-bd3a-9a14411c168f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.105265 Jul 20 09:36:18.910667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:18 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:19.460648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:19.462512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:19.470701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:19.472150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:19.473317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.476221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.477028 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.477462 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.479829 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.480458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.481376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.482061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.595382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:19.604708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d761a539-0c4c-46c7-9244-5c2fbf68e624 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.141518 Jul 20 09:36:19.605273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 29/58] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:19 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:19.610778 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:19.611705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:19.619761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.620370 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.621176 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.621609 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.693316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:19.707876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:19.710578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-61448fbe-f3d1-4fd0-8acf-ccc901e619de tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.103804 Jul 20 09:36:19.711022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:19 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:19.716972 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-265cc10d-f6ab-4f15-8991-a071cde9b405 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.260587 Jul 20 09:36:19.727557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 30/60] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:19 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:19.932508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:19.933114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:19.939094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.939616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:19.940808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:19.941392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.011015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:20.019194 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:20.021600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:20.023054 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b51af53a-e8b7-4691-a7bf-25c1091fbc60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.094421 Jul 20 09:36:20.023789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:19 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:20.624436 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:20.624915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:20.632856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.633432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.634385 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.634812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.716258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:20.727756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:20.728995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:20.729827 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2163a489-831b-49a9-abd5-0e1072e6ffdf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.109123 Jul 20 09:36:20.740691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 31/62] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:20 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:20.742445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.746378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:20.747384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:20.747524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.748274 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.748705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.754409 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.754990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.755970 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:20.756673 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:20.991874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.004198 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f0c24659-5f5c-49dc-bea6-399bb0988b21 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.262110 Jul 20 09:36:21.015270 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:20 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:21.042371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:21.043233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:21.049810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:21.054271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:21.056386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:21.057274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:21.153195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.167931 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b9d417f7-4f2e-4abc-b035-fd7198f47c72 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.444051 Jul 20 09:36:21.170973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 32/64] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:20 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:21.199190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.212928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.214173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.219854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a254740b-6c79-4a4c-b47c-8e8a7588cb45 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.177824 Jul 20 09:36:21.220726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:21 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:21.746435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:21.747213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:21.759814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:21.769080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:21.770207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:21.770818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:21.891061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:21.898870 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b4d19264-21ab-4d96-98de-aaec727b68a2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.156372 Jul 20 09:36:21.899476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:21 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:22.023126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:22.024402 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:22.030459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.031059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.031989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.032416 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.189803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:22.190811 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:22.198548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.199805 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.201061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.201592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.203325 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:22.214138 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-153324a3-92b8-42f9-b445-10bf25038bf9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.195623 Jul 20 09:36:22.214736 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:22 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:22.243735 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:22.244508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:22.251418 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.251867 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.252631 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.253062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.309804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:22.325958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b7f0bba2-a54e-40f8-8ffc-0fd01812d81b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.140922 Jul 20 09:36:22.327124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:22 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:22.345787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:22.365341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:22.366910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:22.368126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9e91170f-662c-4bd2-b1d3-e8c5e0667a3e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.133420 Jul 20 09:36:22.368702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 35/69] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:22 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:22.917165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:22.918469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:22.925428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.926214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:22.927996 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:22.928970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.028712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.044506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e96b8d8c-b561-4138-a9e7-d4d5109ddcf9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.132410 Jul 20 09:36:23.045229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:22 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:23.234186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:23.235239 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:23.249400 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.250278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.252447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.253505 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.343890 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:23.344829 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:23.352671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.353387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.354688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.355348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.449638 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.457704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-94aa326f-8e58-48db-9380-0887b0465a9d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.117986 Jul 20 09:36:23.459237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:23 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:23.483792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:23.485092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:23.495144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.496580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.497259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.498246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:23.498897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:23.510408 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3dc82c76-3eed-4bb0-83f4-84989bd0e2a5 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.283392 Jul 20 09:36:23.520264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 36/72] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:23 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:23.592221 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.605319 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.608026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:23.609357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4a5f39cb-1844-477e-93a4-8d374a26a72e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.148881 Jul 20 09:36:23.610125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 37/73] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:23 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:24.063794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:24.064689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:24.076794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.077398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.078310 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.078877 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.194327 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:24.204549 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bf6f2453-5bec-4c08-a861-6f15cfe2da71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.143659 Jul 20 09:36:24.205841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:24 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:24.475370 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:24.475982 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:24.483916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.486211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.488005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.489094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.527895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:24.529271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:24.535889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.553731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.556102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.558426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.840665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:24.852643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d09f657c-4676-4683-8e3b-1f1d2ad82e59 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.381129 Jul 20 09:36:24.858084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:24 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:24.864322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:24.871842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:24.885101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.888930 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.892849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:24.893476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:24.914934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:24.934709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3294c4f0-653d-456a-adee-fda502345892 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.407376 Jul 20 09:36:24.946176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:24 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:24.951874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:25.057934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:25.076467 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:25.078024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:25.094115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-552a5ac4-a728-4105-b6c3-a8a8512ae41b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.233139 Jul 20 09:36:25.104752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 39/77] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:24 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:25.224972 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:25.228546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:25.266164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.266713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:25.274954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.276720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:25.575181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:25.588049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fb554f33-591b-4fb7-90ae-35593a59d363 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1292 microversion: 2.1 time: 0.369528 Jul 20 09:36:25.590236 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:25 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:25.890335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:25.895329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:25.912119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.913288 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:25.914381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.915168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:25.951944 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:25.952598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:25.967776 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.968516 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:25.969883 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:25.970635 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:26.005998 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.019131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4d495dbf-5bd6-40dd-9940-9081ed063b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.147598 Jul 20 09:36:26.029510 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:25 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:26.116144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:26.117618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:26.131464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:26.131464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:26.131464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:26.131464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:26.306463 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.328959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.334969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.336337 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7d22baa9-702e-4829-beb6-15dfa77666d2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.226538 Jul 20 09:36:26.337233 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 41/80] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:26 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:26.609770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:26.610874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:26.637252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:26.637746 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:26.639976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:26.640612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:26.794784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.806076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f6883504-b9c3-41fb-85b1-20e033bbadd0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1280 microversion: 2.1 time: 0.203365 Jul 20 09:36:26.808063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 42/81] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:26 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:26.899125 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:26.918933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1ec71a6e-d0d0-4984-885c-4753aa1dc315 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.970660 Jul 20 09:36:26.930419 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 40/82] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:25 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:27.041860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:27.043356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:27.053077 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.053708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.057167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.057865 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.179023 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:27.194776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0b3216f8-108b-4c65-943c-4c46f7ddfa76 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1296 microversion: 2.1 time: 0.160630 Jul 20 09:36:27.197457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:27 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1296 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:27.355593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:27.356196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:27.363102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.363577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.364338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.365325 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.390961 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-f0f1bff7-6289-4e03-a1fa-ccd5fcd3a686 req-4b78903e-fb45-4425-b5bb-88c735369e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c84549-5164-4a35-8506-347bb225c7db", "tag": "0199fcb9-1c58-40e7-a6b2-ca968ecb950d"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:27.406825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f0f1bff7-6289-4e03-a1fa-ccd5fcd3a686 req-4b78903e-fb45-4425-b5bb-88c735369e01 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.407272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f0f1bff7-6289-4e03-a1fa-ccd5fcd3a686 req-4b78903e-fb45-4425-b5bb-88c735369e01 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.429624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:27.432263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-f0f1bff7-6289-4e03-a1fa-ccd5fcd3a686 req-4b78903e-fb45-4425-b5bb-88c735369e01 service nova] Creating event network-changed:0199fcb9-1c58-40e7-a6b2-ca968ecb950d for instance 83c84549-5164-4a35-8506-347bb225c7db on hv-cinder-82282 Jul 20 09:36:27.434283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f0f1bff7-6289-4e03-a1fa-ccd5fcd3a686 req-4b78903e-fb45-4425-b5bb-88c735369e01 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 09:36:27.435494 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:27.436004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.436442 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.437227 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.437809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.447260 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:27.449141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:27.450607 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.compute.rpcapi [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 09:36:27.451213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a5d1a368-b886-4848-b701-861d550972a7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1339 microversion: 2.20 time: 0.098841 Jul 20 09:36:27.451544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] Releasing lock "compute-rpcapi-router" {{(pid=124374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 09:36:27.451827 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 44/84] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:27 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:27.477280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-98580392-1b45-4420-9b5b-5b11c7af90fb None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172205 Jul 20 09:36:27.477901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 41/85] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:27.838637 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:27.839184 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:27.853334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.853782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.854550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.854981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.938157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:27.939152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:27.948953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.953836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:27.954782 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:27.955228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:28.114868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:28.125778 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3520c27a-74f6-4ea8-b1f3-2b52135998f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.303055 Jul 20 09:36:28.136115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 45/86] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:27 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:28.218366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:28.220391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:28.246541 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:28.247652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:28.249870 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:28.251010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:28.329117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:28.354907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-99632e14-2d10-4ae6-9f37-7b49a3582fd9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.420205 Jul 20 09:36:28.368288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 42/87] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:27 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:28.421895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:28.442582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6b0b08a4-2c08-45e1-910b-7bb7713a0e53 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.232077 Jul 20 09:36:28.456966 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 46/88] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:28 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:28.472166 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:28.473025 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:28.486435 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:28.486883 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:28.487688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:28.490320 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.246431 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-1f4b8b8b-c44d-46a5-9e72-257f7c511af1 req-74526fe5-2a36-4a5b-ad03-03034891ea41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69dd79a4-13b6-4962-85c9-ab27f895facb", "tag": "a4b4ceb3-6606-477a-a921-d57e2379731b"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:29.259865 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-1f4b8b8b-c44d-46a5-9e72-257f7c511af1 req-74526fe5-2a36-4a5b-ad03-03034891ea41 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.260705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-1f4b8b8b-c44d-46a5-9e72-257f7c511af1 req-74526fe5-2a36-4a5b-ad03-03034891ea41 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.287322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-1f4b8b8b-c44d-46a5-9e72-257f7c511af1 req-74526fe5-2a36-4a5b-ad03-03034891ea41 service nova] Creating event network-changed:a4b4ceb3-6606-477a-a921-d57e2379731b for instance 69dd79a4-13b6-4962-85c9-ab27f895facb on hv-cinder-82282 Jul 20 09:36:29.288361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-1f4b8b8b-c44d-46a5-9e72-257f7c511af1 req-74526fe5-2a36-4a5b-ad03-03034891ea41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 09:36:29.289618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.290041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.290959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.291572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.301048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.compute.rpcapi [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 09:36:29.302191 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] Releasing lock "compute-rpcapi-router" {{(pid=124373) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 09:36:29.322390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-db322a37-7105-4522-bd66-cc58bffc99bd None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233997 Jul 20 09:36:29.325762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 47/89] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:29.333022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:29.334668 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:29.343749 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.344192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.345067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.345503 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.595886 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:29.604209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:29.605484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c67216d5-5959-4452-b3d3-5dca122668dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.278338 Jul 20 09:36:29.606500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:29 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:29.612037 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:29.612704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:29.615486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:29.619852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:29.621007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5c03bf01-5701-4056-821d-2e9ac218444c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 1.154337 Jul 20 09:36:29.621145 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.621603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.622365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.622799 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.626699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 43/91] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:28 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:29.632806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:29.633394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:29.650267 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.650779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.651953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:29.652598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:29.797455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:29.809627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2278f160-6959-4e53-ba2f-942eb50e177c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.201539 Jul 20 09:36:29.810212 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 49/92] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:29 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:29.816860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1086927749", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "networks": [{"uuid": "62d7b8d9-8d7e-4751-b1cf-35e38e741657"}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:29.889040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] validate_networks() for [('62d7b8d9-8d7e-4751-b1cf-35e38e741657', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:36:30.336467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:30.350455 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-15189000-304e-463e-a2f2-e551692032ab tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.721194 Jul 20 09:36:30.351064 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 44/93] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:29 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:30.397229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:36:30.398172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:36:30.399071 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:36:30.399450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:36:30.400196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:36:30.412505 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.413403 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:30.414192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.415130 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:30.436908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Getting quotas for project 298d7611d92a47fd94dd66c8ff10a7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:36:30.451830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Getting quotas for user 7ed56ed8be784927917986375a76df4c and project 298d7611d92a47fd94dd66c8ff10a7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:36:30.466250 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:36:30.469984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:36:30.548729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7b9af12e-ef2e-45d5-bd02-ff36691f8963 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735556 Jul 20 09:36:30.550179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 50/94] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:36:30.561133 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9b251e7b-cbee-4ce5-a553-8b8ace14c51b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:30.562020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9b251e7b-cbee-4ce5-a553-8b8ace14c51b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:30.624985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:30.626464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:30.637089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.637922 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:30.640643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.641645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:30.951644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9b251e7b-cbee-4ce5-a553-8b8ace14c51b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:30.961779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9b251e7b-cbee-4ce5-a553-8b8ace14c51b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1219 microversion: 2.1 time: 0.404624 Jul 20 09:36:30.963677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:30 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:30.969173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:30.969951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:30.977502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.978196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:30.979165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:30.979797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.045496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.055656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a86cdfbb-c49e-4a60-82d8-041ef2a62b7a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.437219 Jul 20 09:36:31.056298 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:30 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:31.072647 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:31.073511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:31.082474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.083155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.084222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.085648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.446929 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.465943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9abe43f5-2d2b-4ba6-af1c-67e69bdd1f57 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.398628 Jul 20 09:36:31.473091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 52/97] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:31 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:31.479007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:31.482187 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:31.502868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.503631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.504669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.506554 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.803088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.807217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.817258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.818250 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5c67033e-b1b6-450e-a5d2-078aeb3b2b25 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.342658 Jul 20 09:36:31.819592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 53/98] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:31 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:31.824111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:31.828007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-096a9c59-5953-44c9-8ded-2df02d64663a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.861884 Jul 20 09:36:31.842407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 46/99] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:30 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:31.978722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:31.979603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:31.986146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.986835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:31.987804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:31.988474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.013550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-65a7ff50-6111-46bb-9c6f-cc66e3d25744 req-8d5e8e08-ea0e-47a4-ab20-e87e58027178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:32.029441 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-65a7ff50-6111-46bb-9c6f-cc66e3d25744 req-8d5e8e08-ea0e-47a4-ab20-e87e58027178 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.032834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-65a7ff50-6111-46bb-9c6f-cc66e3d25744 req-8d5e8e08-ea0e-47a4-ab20-e87e58027178 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.054742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-65a7ff50-6111-46bb-9c6f-cc66e3d25744 req-8d5e8e08-ea0e-47a4-ab20-e87e58027178 service nova] Creating event network-changed:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:36:32.078113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-65a7ff50-6111-46bb-9c6f-cc66e3d25744 req-8d5e8e08-ea0e-47a4-ab20-e87e58027178 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068071 Jul 20 09:36:32.082338 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 47/100] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:32.091858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:32.094555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:32.100343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:32.106483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0d737841-73d4-4bd3-ade0-a1b2ca899696 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1279 microversion: 2.1 time: 0.131718 Jul 20 09:36:32.108070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 54/101] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:31 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:32.113462 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.113929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.115017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.115907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.352428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:32.362363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e0e513a9-46a4-4a79-be10-bcb0d31034bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.277857 Jul 20 09:36:32.372591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 48/102] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:32 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:32.489599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:32.490447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:32.497221 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.497670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.498469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.498903 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.632921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:32.640227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-084acbcb-7769-4e0c-816e-1d1c7cb4e629 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.154462 Jul 20 09:36:32.640795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 55/103] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:32 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:32.835865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:32.836469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:32.845187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.845627 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.846482 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.846901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.847080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:32.848153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:32.856546 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.856989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:32.857794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:32.858279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.004046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.006232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.012711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.014258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a807b672-7123-4fdc-9c07-021faf85a78d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.182386 Jul 20 09:36:33.014782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.014897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 49/104] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:32 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:33.015474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8a83a4d0-da98-4ee4-bbc0-6d374b1aa886 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.172742 Jul 20 09:36:33.016123 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 56/105] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:32 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:33.124317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:33.124912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:33.131120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.131582 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.132317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.132738 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.194378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.201731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-465bf471-64f8-4d5c-9d41-74dcc6ea5c5d tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1279 microversion: 2.1 time: 0.081215 Jul 20 09:36:33.202287 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 50/106] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:33 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:33.380252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:33.380889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:33.386928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.387406 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.388151 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.388581 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.392607 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:33.528312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.535867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c3458e20-2d01-4c36-8e2c-30058c9e3ee5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.159459 Jul 20 09:36:33.536508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 57/107] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:33 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:33.656822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:33.657457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:33.663815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.664331 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.665091 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:33.665520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:33.797145 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:33.805922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4ad341ff-1e10-427e-90a7-10d92e2fbe85 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.152854 Jul 20 09:36:33.806563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 51/108] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:33 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:34.032005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:34.032604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:34.032730 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:34.033281 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:34.039406 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.039851 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.040394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.040599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.040881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.041045 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.041551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.047624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.194693 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:34.197257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:34.202696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-417b5154-bac5-4dc0-bbe5-aa2e91f514b9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.174435 Jul 20 09:36:34.205174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:34.206660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:34.207782 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-89cd605e-66cb-4b3d-afee-95070e088f3c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.178908 Jul 20 09:36:34.208882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 52/109] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:34 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:34.215757 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 58/110] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:34 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:34.220462 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:34.221248 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:34.222521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ab6169-0ddb-45df-a77d-e9ab309261b1", "tag": "d3d9760d-e62d-4793-afa5-a0990048268c"}, {"name": "network-changed", "server_uuid": "09550419-8417-4448-af4b-10d9534548a4", "tag": "77eb85d9-70f1-486d-aade-4ad658042670"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:34.228712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.229150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.229904 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.230327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.232251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.232678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.245050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] Creating event network-changed:d3d9760d-e62d-4793-afa5-a0990048268c for instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 on hv-cinder-82282 Jul 20 09:36:34.245776 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] Creating event network-changed:77eb85d9-70f1-486d-aade-4ad658042670 for instance 09550419-8417-4448-af4b-10d9534548a4 on hv-cinder-82282 Jul 20 09:36:34.252170 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-4764fff8-9765-4de2-84af-e90700ceb654 req-c6a9f409-a275-4eaa-a33d-3caaa8686fd9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041819 Jul 20 09:36:34.252945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 53/111] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:34.297644 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:34.306203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-520015d7-a2a6-494e-81dc-ce5a8cd505e6 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1279 microversion: 2.1 time: 0.089401 Jul 20 09:36:34.306944 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 59/112] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:34 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:34.555512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:34.556674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:34.563604 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.564451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.565500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.566118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.824400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:34.825133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:34.837934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.838494 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:34.839357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:34.839862 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.162006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.171425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8306b997-aab1-4914-9bc9-a83e96cb908b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.621671 Jul 20 09:36:35.172245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 54/113] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:34 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:35.210307 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.217981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-422b5afe-f74a-4a81-878d-624fb4bcda1b tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.397880 Jul 20 09:36:35.218527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 60/114] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:34 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:35.226737 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:35.227375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:35.236055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.236209 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:35.236499 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.236771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:35.237327 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.237690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.242683 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.243119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.244105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.244535 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.371742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.377487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.379620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.381731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.382814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a69c7ada-156d-429b-8669-b053e6b901bb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.160863 Jul 20 09:36:35.383375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 55/115] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:35 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:35.388007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:35.388591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:35.389647 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1fb1baa9-9f2c-49f2-a1c1-04f1ba41896e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.161021 Jul 20 09:36:35.390428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 61/116] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:35 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:35.394471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.394899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.395656 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:35.396767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:35.458851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:35.466381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-94fa5189-e5bf-4adc-9ed3-f18f3689d837 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1277 microversion: 2.1 time: 0.081749 Jul 20 09:36:35.466945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 56/117] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:35 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:36.188855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:36.189488 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:36.196019 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.196489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.197226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.197648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.235979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:36.236550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:36.242722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.243156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.243958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.244346 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.333419 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.341129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-55ca6fb2-c6b4-43e2-8995-fbf429deb856 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.156006 Jul 20 09:36:36.341741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 62/118] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:36 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:36.389616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.397637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8315ee66-c3a7-4254-9abe-4207f7801153 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.165402 Jul 20 09:36:36.398189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:36 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:36.401842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:36.402565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:36.405928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:36.406274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:36.409370 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.409803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.410574 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.411065 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.412800 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.413499 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.414246 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.414680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.550461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.555541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.559759 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.561350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.562450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fd825aad-b39f-4081-ba5e-93d9ae910847 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.164674 Jul 20 09:36:36.562677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ae99e034-5338-4009-8af7-2abf585f8af6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.160840 Jul 20 09:36:36.563000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 63/120] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:36 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:36.563182 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 58/121] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:36 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:36.571854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:36.571854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:36.574301 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.574734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.575517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:36.575940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:36.637987 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:36.645336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9d4ccd36-a453-4377-be89-ce490932ec67 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1277 microversion: 2.1 time: 0.081080 Jul 20 09:36:36.646769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 64/122] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:36 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:37.357570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:37.358167 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:37.364230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.365191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.365977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.366401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.414558 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:37.415159 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:37.421129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.421569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.422314 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.422740 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.450934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:37.498662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:37.506301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d8c60621-30bf-4872-8c06-d432ba371036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.152492 Jul 20 09:36:37.506874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 59/123] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:37 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:37.556922 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:37.565021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c84e8526-e9ac-4047-af71-bde584dc4ea8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.154567 Jul 20 09:36:37.565951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 65/124] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:37 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:37.579196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:37.579830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:37.580656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:37.581264 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:37.586527 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.586965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.587533 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.587791 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.587981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.588383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.588734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.589178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.610322 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:37.851854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:37.870074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:37.871639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:37.872808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c70a8cf1-628e-4c2c-a4b2-b02a609366b6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.295867 Jul 20 09:36:37.873618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 66/125] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:37 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:37.895101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:37.896683 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:37.906419 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.907604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.909244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:37.909687 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:37.999075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:38.008131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0e34ce5e-7f59-439d-8957-c070c8013261 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1277 microversion: 2.1 time: 0.119652 Jul 20 09:36:38.008724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 67/126] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:37 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:38.274617 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:38.295062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a453508b-0176-4f75-b83f-8239a27b4c30 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.719631 Jul 20 09:36:38.302446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 60/127] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:37 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:38.522363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:38.522969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:38.529725 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.530168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.530927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.531475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.584952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:38.585605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:38.595987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.596712 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.597609 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.598426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.690623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:38.700527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1a5a589b-5fe9-4c64-bdf1-65ef607410b7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.182344 Jul 20 09:36:38.711148 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 68/128] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:38 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:38.897544 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:38.898959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:38.907538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.908200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.909130 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:38.909836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:38.913770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:38.928606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-50af1515-a702-4c48-818d-f088e345caf1 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.347158 Jul 20 09:36:38.933892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 61/129] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:38 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:39.026665 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:39.028182 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:39.046300 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.054383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.056716 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.058426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.109888 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.118518 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.120422 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.121778 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-49414e77-3d94-4840-a03f-5b3f91a3ef15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.231407 Jul 20 09:36:39.122935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 69/130] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:38 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:39.246910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.256720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-506fc2ca-bca0-4db1-aba6-3ca0ff54c4fa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.234796 Jul 20 09:36:39.258422 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 62/131] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:39 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:39.313059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:39.313889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:39.323188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.324082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.325580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.326151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.345175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-8c163c00-dcf9-4a51-944c-bca58b47c8f3 req-e10dcfa4-9b4b-4aab-9e8c-10e9cf2ccd05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dd79a4-13b6-4962-85c9-ab27f895facb", "name": "network-vif-plugged", "status": "completed", "tag": "a4b4ceb3-6606-477a-a921-d57e2379731b"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:39.355270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:39.358612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-8c163c00-dcf9-4a51-944c-bca58b47c8f3 req-e10dcfa4-9b4b-4aab-9e8c-10e9cf2ccd05 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.359430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-8c163c00-dcf9-4a51-944c-bca58b47c8f3 req-e10dcfa4-9b4b-4aab-9e8c-10e9cf2ccd05 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.387958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-8c163c00-dcf9-4a51-944c-bca58b47c8f3 req-e10dcfa4-9b4b-4aab-9e8c-10e9cf2ccd05 service nova] Creating event network-vif-plugged:a4b4ceb3-6606-477a-a921-d57e2379731b for instance 69dd79a4-13b6-4962-85c9-ab27f895facb on hv-cinder-82282 Jul 20 09:36:39.394235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-8c163c00-dcf9-4a51-944c-bca58b47c8f3 req-e10dcfa4-9b4b-4aab-9e8c-10e9cf2ccd05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231115 Jul 20 09:36:39.394605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 70/132] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:39.703440 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.710693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4f85d3a4-5509-4107-8040-0c0e662acc62 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.402679 Jul 20 09:36:39.711260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 63/133] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:39 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:39.721933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:39.723659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:39.732727 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.733661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.734702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.735245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.934120 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:39.948969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d79d0c94-7285-467f-9e50-7bdaf3d23dae tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.234691 Jul 20 09:36:39.949330 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:39.949987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:39.950207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 71/134] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:39 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:39.961988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.961988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:39.961988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:39.961988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.149063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:40.153677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:40.180850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.181577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.182821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.187507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.216266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:40.224941 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5b8a04cd-b989-4f2b-8aa0-72aff3d3e501 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.279426 Jul 20 09:36:40.245126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 64/135] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:39 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:40.275030 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:40.275679 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:40.282287 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.287532 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.288649 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.299435 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.424969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=4 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:40.459382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:40.485932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:40.499411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:40.502056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:40.503614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7bbfd031-af3f-4458-b72e-e2c78e260d03 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.364347 Jul 20 09:36:40.504505 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 72/136] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:40 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:40.596941 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:40.618846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-32b4053d-4914-479d-9480-b1e902ea51f1 req-b06e3ba4-a931-4027-b522-6978beece26f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da36441-0cf4-4086-8faa-5b31b5b44424", "tag": "858a2557-dd95-4202-9ad4-6f69f24ea78a"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:40.623270 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7c74af1b-6c77-4fc8-a2e5-c19397a657da tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.342181 Jul 20 09:36:40.625874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 65/137] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:40 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:40.629932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-32b4053d-4914-479d-9480-b1e902ea51f1 req-b06e3ba4-a931-4027-b522-6978beece26f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.631416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-32b4053d-4914-479d-9480-b1e902ea51f1 req-b06e3ba4-a931-4027-b522-6978beece26f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.648456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-32b4053d-4914-479d-9480-b1e902ea51f1 req-b06e3ba4-a931-4027-b522-6978beece26f service nova] Creating event network-changed:858a2557-dd95-4202-9ad4-6f69f24ea78a for instance 8da36441-0cf4-4086-8faa-5b31b5b44424 on hv-cinder-82282 Jul 20 09:36:40.654752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-32b4053d-4914-479d-9480-b1e902ea51f1 req-b06e3ba4-a931-4027-b522-6978beece26f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040040 Jul 20 09:36:40.655598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 73/138] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:36:40.737851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:40.738550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:40.751425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.752073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.760478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.761832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.960240 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:40.969709 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:40.971477 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:40.994134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.995210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:40.996604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:40.999390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.363014 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:41.377864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-63791abf-ab0c-4a25-851c-5f15c64d2553 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.413802 Jul 20 09:36:41.378944 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 74/139] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:40 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:41.385878 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:41.386735 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:41.407728 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.412731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.414955 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.415884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.432632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:41.719604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:41.743539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-40ef6fe3-84f0-4774-b5e5-34361d55a650 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.358685 Jul 20 09:36:41.744795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 75/140] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:41 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:41.765522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:41.767408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:41.790751 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.791587 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.793006 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.798305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.810004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:41.819072 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-220c04a1-28b3-4fbf-8c2c-ce19a4cbebb5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 1.095064 Jul 20 09:36:41.819674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 66/141] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:40 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:41.830279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:41.835585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:41.863066 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.863513 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:41.867721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:41.868310 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.064704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:42.079023 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:42.081034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:42.083774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a3fb0cdb-c113-482a-abb3-0475f6661077 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.335873 Jul 20 09:36:42.085025 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 76/142] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:41 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:42.397081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:42.398043 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:42.412938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.413814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.414755 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.415474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.422657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:42.464299 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-282271c2-74c6-4f48-befc-b1e973ab1f8c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.637573 Jul 20 09:36:42.469093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 67/143] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:41 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:42.672375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:42.680958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-15578e48-1a35-4e09-b730-071ccaf0a3e1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.288994 Jul 20 09:36:42.681813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 77/144] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:42 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:42.763552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:42.764178 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:42.766188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=99 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:42.774984 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.775124 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.775864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.776313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.842843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:42.842843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:42.854334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.855678 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:42.856831 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:42.857975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.031236 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.047697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b83cbcb8-ca2e-4f9d-9f93-98ffb4cd3ff9 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.287660 Jul 20 09:36:43.051830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 68/145] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:42 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:43.104322 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:43.104924 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:43.115898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.116370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.117257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.117707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.130822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.141802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1be28664-996b-4811-a25e-c68dcdb2d037 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.306449 Jul 20 09:36:43.142391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 78/146] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:42 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:43.415113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e269eb72-2e14-4113-af93-eda52bbc0a36 req-c89289d7-4932-4806-a042-e7bacb37e05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c84549-5164-4a35-8506-347bb225c7db", "name": "network-vif-plugged", "status": "completed", "tag": "0199fcb9-1c58-40e7-a6b2-ca968ecb950d"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:43.428741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e269eb72-2e14-4113-af93-eda52bbc0a36 req-c89289d7-4932-4806-a042-e7bacb37e05a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.429163 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e269eb72-2e14-4113-af93-eda52bbc0a36 req-c89289d7-4932-4806-a042-e7bacb37e05a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.454889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e269eb72-2e14-4113-af93-eda52bbc0a36 req-c89289d7-4932-4806-a042-e7bacb37e05a service nova] Creating event network-vif-plugged:0199fcb9-1c58-40e7-a6b2-ca968ecb950d for instance 83c84549-5164-4a35-8506-347bb225c7db on hv-cinder-82282 Jul 20 09:36:43.477745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e269eb72-2e14-4113-af93-eda52bbc0a36 req-c89289d7-4932-4806-a042-e7bacb37e05a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066347 Jul 20 09:36:43.478365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 79/147] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:36:43.486147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:43.486848 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:43.499727 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.500268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.500940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.501346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.670521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.681416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-91bd1ff2-0839-4171-87e6-b8dcec300c0f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.198890 Jul 20 09:36:43.682817 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 80/148] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:43 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:43.694179 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.698896 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:43.699492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:43.705926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.707219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.707844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.708662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:43.708896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.709099 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:43.711102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-294d521f-7425-4277-a7ec-b02b0a696c06 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.612290 Jul 20 09:36:43.712311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 69/149] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:43 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:43.973985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:43.985717 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9c8adb9a-5c53-4b13-b419-956b5cf8bc22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.290698 Jul 20 09:36:43.986308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 81/150] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:43 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:44.073761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:44.074680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:44.081957 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.082605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.084143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.086260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.160970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:44.161975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:44.187667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.192320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.193491 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.194009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.377612 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:44.388225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7bd96765-66a8-4c07-a5c4-b207339ef4b8 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.318744 Jul 20 09:36:44.390830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 70/151] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:44 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:44.615119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:44.624290 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0501bdf4-de8e-4099-8800-1c4a3dfc5ecb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.468894 Jul 20 09:36:44.634625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 82/152] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:44 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:44.698324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:44.698999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:44.707030 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.707674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.710043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.715616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.730373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:44.731105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:44.740220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.740847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.742534 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:44.743353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:44.989133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.003392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.005240 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.007186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-88db3b78-ca35-4307-a010-dc3ae5a50c96 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.281219 Jul 20 09:36:45.008605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 83/153] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:44 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:45.013916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:45.014687 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:45.023391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.024157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.025195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.025995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.182725 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.195163 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c0ac8587-cb67-467d-98d7-d1a090bf448b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.500826 Jul 20 09:36:45.206818 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 71/154] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:44 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:45.277098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.288337 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-777ee7d2-8392-43d7-a4c0-a3754cd4bbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.278210 Jul 20 09:36:45.298327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 84/155] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:45 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:45.408574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:45.409250 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:45.423464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.424615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.427766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.428824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.561797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab6169-0ddb-45df-a77d-e9ab309261b1", "name": "network-vif-plugged", "status": "completed", "tag": "d3d9760d-e62d-4793-afa5-a0990048268c"}, {"server_uuid": "09550419-8417-4448-af4b-10d9534548a4", "name": "network-vif-plugged", "status": "completed", "tag": "77eb85d9-70f1-486d-aade-4ad658042670"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:45.583643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.590151 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.638171 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] Creating event network-vif-plugged:d3d9760d-e62d-4793-afa5-a0990048268c for instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 on hv-cinder-82282 Jul 20 09:36:45.639603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] Creating event network-vif-plugged:77eb85d9-70f1-486d-aade-4ad658042670 for instance 09550419-8417-4448-af4b-10d9534548a4 on hv-cinder-82282 Jul 20 09:36:45.658058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-37bef48b-fbf6-4f34-99c1-c8927f7001e4 req-2e57983d-a804-4b39-8990-c6a4f35d309b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101583 Jul 20 09:36:45.661760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 85/156] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:45.673930 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:45.676550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:45.696219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.696895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.697809 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:45.698408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:45.750188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.766977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ff7bee54-c659-41a2-a1db-67e5fffa717a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1314 microversion: 2.1 time: 0.364114 Jul 20 09:36:45.768560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 72/157] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:45 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:45.931365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:45.940402 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fd47eb1e-462e-4fe1-84be-a9c74fb1a401 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.276087 Jul 20 09:36:45.941270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 86/158] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:45 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:46.028405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:46.029019 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:46.038739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.039200 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.040193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.040628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.213650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:46.217153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:46.224659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.225384 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.226407 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.227059 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.244249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:46.254565 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:46.256502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:46.257629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-20cb1ae4-9271-4f3d-a28f-96c0c88ccf69 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.234498 Jul 20 09:36:46.258202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 73/159] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:46 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:46.306533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:46.307326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:46.314770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.315474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.316716 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.317297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.415769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:46.424875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bff9e741-1f50-4c00-935a-a9d098d48f60 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.216142 Jul 20 09:36:46.425927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 87/160] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:46 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:46.573373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:46.586992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-99c178d8-41f1-4543-9ef6-da7652bcc701 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.285711 Jul 20 09:36:46.587903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 74/161] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:46 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:46.794455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:46.795068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:46.803616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.803616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.803857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.804211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.958907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:46.960778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:46.975068 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.975583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:46.976863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:46.979517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.027128 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.037703 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6cae0b4b-94e6-4d56-afd5-1839696a504c tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1500 microversion: 2.1 time: 0.252553 Jul 20 09:36:47.054080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 88/162] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:46 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:47.233023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.244076 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a3895879-3607-461d-a76e-60ea4184fa16 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.289634 Jul 20 09:36:47.254119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 75/163] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:46 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:47.280843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:47.281448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:47.295210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.300986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.302130 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.307338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.455545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:47.456154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:47.469715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.471454 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.480254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.482312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.657596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.671223 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.678894 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.682453 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a4581e4b-8969-40aa-8f20-059c6a0158b8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.408517 Jul 20 09:36:47.697082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 89/164] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:47 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:47.709954 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:47.713316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:47.728447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.729247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.730880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.731828 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.860607 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.870877 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-aa9bcf2d-141e-4b34-8bc2-7a53319dc6db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.429615 Jul 20 09:36:47.871665 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 76/165] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:47 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:47.889896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-8fe06f27-cdaf-4a46-a38e-3a4982352e89 req-8b772a7f-10f0-42be-bf23-2c6fef08e1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "name": "network-vif-plugged", "status": "completed", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:47.900703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8fe06f27-cdaf-4a46-a38e-3a4982352e89 req-8b772a7f-10f0-42be-bf23-2c6fef08e1ae service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:47.901848 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8fe06f27-cdaf-4a46-a38e-3a4982352e89 req-8b772a7f-10f0-42be-bf23-2c6fef08e1ae service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:47.907067 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:47.920972 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-8fe06f27-cdaf-4a46-a38e-3a4982352e89 req-8b772a7f-10f0-42be-bf23-2c6fef08e1ae service nova] Creating event network-vif-plugged:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:36:47.930252 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-8fe06f27-cdaf-4a46-a38e-3a4982352e89 req-8b772a7f-10f0-42be-bf23-2c6fef08e1ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045723 Jul 20 09:36:47.935213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 77/166] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:47.978851 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:47.987983 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d5672df7-5f66-4453-967b-07d0766b0b44 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1322 microversion: 2.1 time: 0.289529 Jul 20 09:36:47.989152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 90/167] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:47 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:48.263463 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:48.265284 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:48.273207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.274204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.275860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.276560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.477830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:48.487461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a0cb9199-1d20-46ea-834a-0e21de15868e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1364 microversion: 2.1 time: 0.228631 Jul 20 09:36:48.490583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 78/168] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:48 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:48.705188 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:48.706291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:48.717102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.717102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.717102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.717102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.889246 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:48.889846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:48.900373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.900827 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.904024 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:48.904478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:48.927526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:48.954733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:48.959600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:48.963934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d9383a83-1a1c-4e6a-8ea7-5ef72cb15acc tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.265375 Jul 20 09:36:48.965152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 91/169] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:48 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:48.997156 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "552bc23b-9300-4295-9805-33599d6647fa"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:48.998650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:49.022132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.022849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.024430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.025122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.376833 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:49.386179 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d5bbc44d-ef7f-4ca3-8bbe-2f3415acd057 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.500633 Jul 20 09:36:49.386690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 79/170] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:48 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:49.401912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:49.402512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:49.412006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.412813 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.414334 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.415063 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.721489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:49.732888 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4572a05b-7b3e-4087-ab34-c8c4330966ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1517 microversion: 2.1 time: 0.335057 Jul 20 09:36:49.742521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 80/171] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:49 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:49.742521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:49.742521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:49.760012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.760481 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.761244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.762032 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.948243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:49.963508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a90ecfbd-3d46-4cb3-a409-baa174443e24 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1549 microversion: 2.1 time: 0.227031 Jul 20 09:36:49.965305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 81/172] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:49 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:49.985912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:49.987900 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:49.996574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.997450 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:49.998391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:49.998954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.046991 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:50.116691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lazy-loading 'flavor' on Instance uuid 29ab6169-0ddb-45df-a77d-e9ab309261b1 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:36:50.299667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1018036f-afc0-4c34-bca2-cc14fbb22926 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "POST /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.306362 Jul 20 09:36:50.300387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 92/173] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:36:48 2022] POST /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:36:50.321801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:50.325473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:50.341416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.343642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fa66b6b7-ccab-4e6a-bc8a-2aeab41ba003 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1/action" status: 200 len: 32 microversion: 2.1 time: 0.365533 Jul 20 09:36:50.344386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.345171 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 82/174] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:36:49 2022] POST /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1/action => generated 32 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:36:50.351312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.356117 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.361173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:50.361883 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:50.379091 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.382968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.399536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.400504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.563321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b95105f7-eaa5-4156-b73e-2bd82c2d262b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247833 Jul 20 09:36:50.564257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 93/175] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:36:50 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:50.569667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:50.570681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:50.577366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.577836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.578579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.579321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.650616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:50.660490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:50.662886 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:50.664335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-872010f1-4230-4f75-b3ee-aa1bb106bc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.311503 Jul 20 09:36:50.664898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 83/176] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:50 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:50.669744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:50.670425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:50.677027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.677587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.678418 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:50.678918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:50.965383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:50.976185 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-893ac94c-cbc9-4d61-8f2f-9bb7afa63a19 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.309983 Jul 20 09:36:50.976764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 84/177] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:50 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:51.092034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:51.100514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4be96c2c-0c18-4bc6-8457-fe99f3f5a366 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.535176 Jul 20 09:36:51.101363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 94/178] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:50 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:51.683369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:51.684525 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:51.690616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:51.691322 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:51.692347 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:51.693300 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:51.834296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:51.844510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:51.846579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:51.848354 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d566fbb1-bbb1-4be2-809d-693bc31880b5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.168933 Jul 20 09:36:51.864293 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 85/179] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:51 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:51.993689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:51.994514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:52.009124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.009124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.009859 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.010281 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.046266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-2559fe2d-687f-4496-96dd-f672f420a9b2 req-5abc342b-6720-43e6-a2c1-bb7b35605731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09550419-8417-4448-af4b-10d9534548a4", "tag": "77eb85d9-70f1-486d-aade-4ad658042670"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:52.070617 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-2559fe2d-687f-4496-96dd-f672f420a9b2 req-5abc342b-6720-43e6-a2c1-bb7b35605731 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.071213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-2559fe2d-687f-4496-96dd-f672f420a9b2 req-5abc342b-6720-43e6-a2c1-bb7b35605731 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.099634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-2559fe2d-687f-4496-96dd-f672f420a9b2 req-5abc342b-6720-43e6-a2c1-bb7b35605731 service nova] Creating event network-changed:77eb85d9-70f1-486d-aade-4ad658042670 for instance 09550419-8417-4448-af4b-10d9534548a4 on hv-cinder-82282 Jul 20 09:36:52.116082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-2559fe2d-687f-4496-96dd-f672f420a9b2 req-5abc342b-6720-43e6-a2c1-bb7b35605731 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073981 Jul 20 09:36:52.118457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 86/180] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:36:52.125187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-cc4d8004-9048-464a-ab3c-835c66889c2b req-c34f7a69-e873-47a0-a63a-91240fd74639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da36441-0cf4-4086-8faa-5b31b5b44424", "name": "network-vif-plugged", "status": "completed", "tag": "858a2557-dd95-4202-9ad4-6f69f24ea78a"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:52.134190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-cc4d8004-9048-464a-ab3c-835c66889c2b req-c34f7a69-e873-47a0-a63a-91240fd74639 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.134988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-cc4d8004-9048-464a-ab3c-835c66889c2b req-c34f7a69-e873-47a0-a63a-91240fd74639 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.149988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-cc4d8004-9048-464a-ab3c-835c66889c2b req-c34f7a69-e873-47a0-a63a-91240fd74639 service nova] Creating event network-vif-plugged:858a2557-dd95-4202-9ad4-6f69f24ea78a for instance 8da36441-0cf4-4086-8faa-5b31b5b44424 on hv-cinder-82282 Jul 20 09:36:52.165693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-cc4d8004-9048-464a-ab3c-835c66889c2b req-c34f7a69-e873-47a0-a63a-91240fd74639 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045228 Jul 20 09:36:52.166309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 87/181] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:36:52.173655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:52.174369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:52.184886 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.185944 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.186896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.187514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.193855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:52.201755 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-cdb52bf6-513d-4309-b573-6aa5be23fd42 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.212859 Jul 20 09:36:52.202642 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:51 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:52.333125 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:52.341325 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6f695a12-5391-49c1-bbc7-5a8ba21b501a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.173881 Jul 20 09:36:52.342096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 88/183] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:52 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:52.871710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:52.872310 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:52.878476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.879146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:52.879937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:52.881116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:53.057752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:53.066315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:53.068526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:53.069972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-311c09e4-fdf1-4e6b-a5a1-64223f476d98 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.202117 Jul 20 09:36:53.070580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 96/184] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:52 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:36:53.219186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:53.219852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:53.227174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:53.227720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:53.228541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:53.229134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:53.359362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:53.359948 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:53.371330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:53.371883 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:53.372659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:53.373087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:53.424308 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:53.435779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-19246835-a971-4682-84d1-6190480a9b0c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.220451 Jul 20 09:36:53.436355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 89/185] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:53 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:53.530219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:53.538098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c1a83cab-1a73-447d-8b14-a699d047f4fe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.182554 Jul 20 09:36:53.538719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 97/186] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:53 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:54.088626 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:54.089300 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:54.095608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.096141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.096947 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.097759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.277693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:54.286144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:54.288337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:54.289718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6997e660-8fdb-496f-b2f9-9151489061ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1407 microversion: 2.20 time: 0.206267 Jul 20 09:36:54.290309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 90/187] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:54 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:54.452546 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:54.453146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:54.459729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.460186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.460937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.461362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.557167 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:54.557954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:54.564838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.565518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.566574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:54.567012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:54.799174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:54.809276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7c3ab3ce-6be3-4540-bac3-e34490cb0ac5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.257127 Jul 20 09:36:54.818703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 91/188] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:54 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:54.866063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:54.891631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-688f54b8-4abc-461e-87c3-e6e673c380f9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.443048 Jul 20 09:36:54.894644 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 98/189] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:54 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:55.309111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:55.309759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:55.318850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.320013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.321265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.321830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.746677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:55.763612 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:55.766109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:55.770225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-585c514e-ca6f-4315-a549-3dd441238a75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1599 microversion: 2.20 time: 0.465304 Jul 20 09:36:55.783411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 92/190] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:36:55 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1599 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:36:55.790208 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:55.791535 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:55.804521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.805081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.806007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.806666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.826021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:55.827103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:55.834165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.834774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.835670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.836162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.888305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-dee0e75b-2c70-46e2-8c04-92a6c05dd5c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103385 Jul 20 09:36:55.888978 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 99/191] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jul 20 09:36:55 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:36:55.909842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:55.910443 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:55.918040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.918728 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.919988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:55.920562 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:55.987605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:55.993010 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:36:55.997527 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-dfad6779-a3f6-4d5a-a6ea-954e2e0d1efc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.175323 Jul 20 09:36:55.998104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 93/192] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:55 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:56.202362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:56.210863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ab3e410f-e81b-43a8-b100-e19c0ccde666 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1319 microversion: 2.1 time: 0.304793 Jul 20 09:36:56.211475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 100/193] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:55 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:36:57.018021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:57.018623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:57.027982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:57.028604 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:57.030272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:57.030857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:57.201670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e6a9ac13-ffd2-41b9-b4bc-12698c07ba55 req-92f31e8e-2d2c-4358-98b6-fcba4946635d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:36:57.214222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e6a9ac13-ffd2-41b9-b4bc-12698c07ba55 req-92f31e8e-2d2c-4358-98b6-fcba4946635d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:57.215063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e6a9ac13-ffd2-41b9-b4bc-12698c07ba55 req-92f31e8e-2d2c-4358-98b6-fcba4946635d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:57.228261 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e6a9ac13-ffd2-41b9-b4bc-12698c07ba55 req-92f31e8e-2d2c-4358-98b6-fcba4946635d service nova] Creating event network-changed:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:36:57.233749 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e6a9ac13-ffd2-41b9-b4bc-12698c07ba55 req-92f31e8e-2d2c-4358-98b6-fcba4946635d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037343 Jul 20 09:36:57.238355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 101/194] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:36:57.244084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:57.245057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:57.251752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:57.252318 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:57.253429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:57.253908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:57.277605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:57.294919 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-db9ab34f-bfd4-4203-b745-ae9665a5751f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.283372 Jul 20 09:36:57.299565 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:57 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:57.470485 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:57.480678 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5187b2b3-40d5-4993-873d-32f0ccbad75a tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1508 microversion: 2.1 time: 0.240787 Jul 20 09:36:57.481257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 102/196] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:57 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:58.313154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:58.314416 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:58.327220 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:58.327791 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:58.340401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:58.348335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:58.741301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:58.756208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-106cf1df-c161-4233-a1b7-55a0befa6b20 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.447288 Jul 20 09:36:58.775729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 95/197] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:58 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:36:59.775614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:36:59.776438 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:36:59.783720 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:59.784404 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:59.785363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:36:59.787899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:36:59.977931 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:36:59.986736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c3afc5f2-e3ae-4d21-888d-84bbc299287c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.216072 Jul 20 09:36:59.987673 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 103/198] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:36:59 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:01.003828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:01.004402 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:01.010580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:01.010968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:01.011745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:01.012162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:01.161694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:01.169764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-50f4824f-fef7-47ec-af91-d9e800a33951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.169640 Jul 20 09:37:01.170329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 96/199] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:00 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:02.186447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:02.187639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:02.195570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:02.196033 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:02.197148 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:02.197767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:02.371215 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:02.378569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8a25dca5-1119-4fa1-82bb-4c205e994592 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.196215 Jul 20 09:37:02.379143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 104/200] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:02 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:03.396449 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:03.397021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:03.403383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.403831 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.404594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.405051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.532114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:03.532736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:03.542977 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.543767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.546461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.547832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.575093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:03.584653 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f1a76e04-0f1a-4a79-ad68-9633043b8c8b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.191884 Jul 20 09:37:03.586065 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 97/201] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:03 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:03.604245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:37:03.713636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7118c0cc-ac7c-4e40-aaef-28f92eb9f117 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "DELETE /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 204 len: 0 microversion: 2.1 time: 0.185054 Jul 20 09:37:03.714936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 105/202] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:37:03 2022] DELETE /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:37:03.725232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:03.725842 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:03.731853 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.732296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.733059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:03.733487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:03.875394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:03.885395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-40ad6c9b-f7bd-4381-b479-c7472bffa285 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1552 microversion: 2.1 time: 0.165674 Jul 20 09:37:03.886293 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 98/203] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:03 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:04.602300 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:04.602996 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:04.610050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:04.610634 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:04.611540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:04.611974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:04.770100 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:04.783175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ceb4409e-7ec1-418f-bf73-0605516a980f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.185599 Jul 20 09:37:04.783788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 106/204] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:04 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:04.904951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:04.905556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:04.912060 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:04.912608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:04.913705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:04.914447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:05.068949 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:05.078051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0dd0db55-56c8-4654-896d-95d1d0f84f03 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1552 microversion: 2.1 time: 0.177020 Jul 20 09:37:05.078601 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 99/205] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:04 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:05.801233 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:05.801853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:05.808419 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:05.808860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:05.809610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:05.810035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:05.953512 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:05.961416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2e80351c-5c8a-4240-b0ab-1d731fd676d1 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.163952 Jul 20 09:37:05.962103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 107/206] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:05 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:06.094206 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:06.094804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:06.102747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:06.103343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:06.104232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:06.104687 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:06.253011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:06.263417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b8661b2c-2bcf-498a-86dd-a8076c2171c3 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1552 microversion: 2.1 time: 0.173000 Jul 20 09:37:06.263915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 100/207] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:06 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:06.982141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:06.983226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:06.992272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:06.992991 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:06.995792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:06.997852 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:07.033211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:07.186374 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:07.201893 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ffa5475f-e190-492b-8eaa-c15ce0f86652 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.226820 Jul 20 09:37:07.202480 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 108/208] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:06 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:07.234758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-7c9a71dd-9311-4ead-86c3-df1201083a90 req-c4cb4f60-6b4c-4250-9efd-6bcc8928a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c84549-5164-4a35-8506-347bb225c7db", "name": "network-vif-deleted", "tag": "0199fcb9-1c58-40e7-a6b2-ca968ecb950d"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:07.245514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7c9a71dd-9311-4ead-86c3-df1201083a90 req-c4cb4f60-6b4c-4250-9efd-6bcc8928a322 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:07.246097 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7c9a71dd-9311-4ead-86c3-df1201083a90 req-c4cb4f60-6b4c-4250-9efd-6bcc8928a322 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:07.266156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-7c9a71dd-9311-4ead-86c3-df1201083a90 req-c4cb4f60-6b4c-4250-9efd-6bcc8928a322 service nova] Creating event network-vif-deleted:0199fcb9-1c58-40e7-a6b2-ca968ecb950d for instance 83c84549-5164-4a35-8506-347bb225c7db on hv-cinder-82282 Jul 20 09:37:07.278958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-7c9a71dd-9311-4ead-86c3-df1201083a90 req-c4cb4f60-6b4c-4250-9efd-6bcc8928a322 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Jul 20 09:37:07.280729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 101/209] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:37:07.283583 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:07.284400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:07.292134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:07.292645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:07.293511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:07.294210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:07.365562 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d24d55fab4e9e852f2c65c771be17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f923122fff9b4011a092bb70c4ec6ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:07.374000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-31e38b83-0c0e-4be8-bc5c-3c42e667b2de tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 200 len: 1345 microversion: 2.1 time: 0.096446 Jul 20 09:37:07.374694 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 109/210] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:07 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:08.220893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:08.221606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:08.242484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.243051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.243723 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.244173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.392084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:08.392704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:08.399166 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:08.399793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.400462 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.401232 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.403125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.408837 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-129d4255-e3d1-4475-bf3c-30d55a56612b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.193560 Jul 20 09:37:08.417052 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 102/211] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:08 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:08.421593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] HTTP exception thrown: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Request method failure captured: Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db HTTP/1.1 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yC5lcQipQ7kvSJ7vv6u5_VmlmeK8VCiob4NZbX1tTguTPTJGALy24Vf977MF55Bk5Cj2ipCxwt665G-_ta6xKUBq6_ce-w4w2iVzDp1Ln1XkUAUm8J6nBHH4mm36aVtDFP4eLuEUZKQSvmCawN8hCsfBlx0K0ohxw_PoCaoUrdrhs Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:37:08.437377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}] Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: a45d24d55fab4e9e852f2c65c771be17 Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.438665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '83c84549-5164-4a35-8506-347bb225c7db'} Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:08.439437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.440743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.442023 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Returning 404 to user: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:08.444096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-77d6fa79-8b39-4336-8648-2409c110bc9a tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 404 len: 111 microversion: 2.1 time: 0.056471 Jul 20 09:37:08.444893 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 110/212] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:08 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:08.560141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:08.561048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:08.566946 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.567439 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.568860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:08.569305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:08.582140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] HTTP exception thrown: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Request method failure captured: Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db/os-volume_attachments HTTP/1.1 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18yC5lcQipQ7kvSJ7vv6u5_VmlmeK8VCiob4NZbX1tTguTPTJGALy24Vf977MF55Bk5Cj2ipCxwt665G-_ta6xKUBq6_ce-w4w2iVzDp1Ln1XkUAUm8J6nBHH4mm36aVtDFP4eLuEUZKQSvmCawN8hCsfBlx0K0ohxw_PoCaoUrdrhs Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:37:08.587411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}] Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: a45d24d55fab4e9e852f2c65c771be17 Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.588834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'server_id': '83c84549-5164-4a35-8506-347bb225c7db'} Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:08.589658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:08.590945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:08.592393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Returning 404 to user: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:08.592393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-abb3b829-007b-45f6-bd85-bcd25ea0a3cc tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032587 Jul 20 09:37:08.595001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:37:08 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:09.433391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:09.433889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:09.441335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.441782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.442543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.443041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.587331 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:09.594690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3942a654-050e-41a9-9e90-a61fbd611efa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.165322 Jul 20 09:37:09.595243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 111/214] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:09 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:09.789931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:09.790711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:09.796690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.797128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.797874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.798294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.816148 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] HTTP exception thrown: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Request method failure captured: Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db HTTP/1.1 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18yC5lcQipQ7kvSJ7vv6u5_VmlmeK8VCiob4NZbX1tTguTPTJGALy24Vf977MF55Bk5Cj2ipCxwt665G-_ta6xKUBq6_ce-w4w2iVzDp1Ln1XkUAUm8J6nBHH4mm36aVtDFP4eLuEUZKQSvmCawN8hCsfBlx0K0ohxw_PoCaoUrdrhs Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:37:09.819176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}] Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: a45d24d55fab4e9e852f2c65c771be17 Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.820717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '83c84549-5164-4a35-8506-347bb225c7db'} Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:09.821546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.822826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.824258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Returning 404 to user: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:09.824258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-79d6eda8-4dc5-4b8a-95e7-0d3f4011bb47 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "DELETE /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 404 len: 111 microversion: 2.1 time: 0.034974 Jul 20 09:37:09.824258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 104/215] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:37:09 2022] DELETE /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:09.833160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:09.834367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] [instance: 83c84549-5164-4a35-8506-347bb225c7db] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:09.836543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:09.842036 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.842470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.843670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:09.844305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:09.866379 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] HTTP exception thrown: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Request method failure captured: Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db HTTP/1.1 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yC5lcQipQ7kvSJ7vv6u5_VmlmeK8VCiob4NZbX1tTguTPTJGALy24Vf977MF55Bk5Cj2ipCxwt665G-_ta6xKUBq6_ce-w4w2iVzDp1Ln1XkUAUm8J6nBHH4mm36aVtDFP4eLuEUZKQSvmCawN8hCsfBlx0K0ohxw_PoCaoUrdrhs Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:37:09.868440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f923122fff9b4011a092bb70c4ec6ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f923122fff9b4011a092bb70c4ec6ff3"}]}] Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: f923122fff9b4011a092bb70c4ec6ff3 Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-DeleteServersTestJSON-907144157 Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: a45d24d55fab4e9e852f2c65c771be17 Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-DeleteServersTestJSON-907144157-project Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.869631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '83c84549-5164-4a35-8506-347bb225c7db'} Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:09.870275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. Jul 20 09:37:09.871373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:09.875877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] Returning 404 to user: Instance 83c84549-5164-4a35-8506-347bb225c7db could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:09.876931 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b87eeff2-5f5b-4bbf-b82c-c5812126cc01 tempest-DeleteServersTestJSON-907144157 tempest-DeleteServersTestJSON-907144157-project] 10.222.0.18 "GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db" status: 404 len: 111 microversion: 2.1 time: 0.047768 Jul 20 09:37:09.877684 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 112/216] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:09 2022] GET /compute/v2.1/servers/83c84549-5164-4a35-8506-347bb225c7db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:10.617300 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:10.621882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:10.628955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:10.628955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:10.629774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:10.630908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:10.903370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:10.914839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-08f29c4e-3a5f-4501-9cd1-d2444320656b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.302705 Jul 20 09:37:10.915689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 105/217] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:10 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:11.933946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:11.934557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:11.941438 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:11.942148 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:11.943633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:11.944068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:12.204689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:12.215117 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d8a4ed69-ed5b-47f6-acb2-da9eec124f70 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.286008 Jul 20 09:37:12.215721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 113/218] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:11 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:13.235271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:13.236528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:13.239276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=76 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:13.248286 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:13.249703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:13.258520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:13.259183 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:13.533948 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:13.547696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c6af2273-cbc6-4fc9-b66f-a84d37e13699 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.317482 Jul 20 09:37:13.549121 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 106/219] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:13 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:14.565608 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:14.566769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:14.573700 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:14.574539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:14.575483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:14.576300 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:14.940449 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:14.950513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0a6bf086-e34a-445c-b38d-07a3031bec7f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.388558 Jul 20 09:37:14.951259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 114/220] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:14 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:15.967911 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:15.969192 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:15.975894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:15.976341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:15.977107 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:15.977552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:16.155202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:16.181715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ef0d93e6-8826-412b-9064-f6c35698fa38 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.216912 Jul 20 09:37:16.185114 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 107/221] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:15 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:17.199443 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:17.200043 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:17.206548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:17.206989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:17.207776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:17.208563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:17.348041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:17.356526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a381fca0-58a5-4072-b8be-0ae97d023ab0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.160998 Jul 20 09:37:17.357090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 115/222] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:17 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:17.428539 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1639713890", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:17.478321 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] validate_networks() for None {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:37:17.872271 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3a595f68-f4dc-4a00-a13b-e3a895debd70 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f47c9af0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:17.921808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3a595f68-f4dc-4a00-a13b-e3a895debd70 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/d019235c-b0a3-4859-9282-f265be47d466" status: 200 len: 350 microversion: 2.1 time: 0.053435 Jul 20 09:37:17.922376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 116/223] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:37:17 2022] GET /compute/v2.1/os-volumes/d019235c-b0a3-4859-9282-f265be47d466 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:17.988914 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:37:17.989349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:37:17.990693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:37:17.991154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:37:17.991584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:37:18.002113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:18.002551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:18.003361 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:18.003962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:18.024688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Getting quotas for project 6d626a45f8a74c748b720ed295079fed. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:37:18.029089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Getting quotas for user 35dfd2a073164dac83acbf686ad7fb8b and project 6d626a45f8a74c748b720ed295079fed. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:37:18.042252 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:37:18.044537 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:37:18.092808 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a2d8148e-7e40-4bf9-a428-e881e86d5113 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668321 Jul 20 09:37:18.093465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 108/224] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:37:18.105133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bc83867e-4316-4880-bedb-ffba17d62e9a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:18.105733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bc83867e-4316-4880-bedb-ffba17d62e9a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:18.158121 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bc83867e-4316-4880-bedb-ffba17d62e9a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:18.166459 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bc83867e-4316-4880-bedb-ffba17d62e9a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1215 microversion: 2.1 time: 0.065758 Jul 20 09:37:18.176027 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 117/225] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:18 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:18.374226 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:18.375077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:18.381941 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:18.382488 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:18.383386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:18.383909 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:18.529224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:18.539243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bff01ee7-526f-4c25-b032-c9049f9a0789 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.168818 Jul 20 09:37:18.540337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 109/226] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:18 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:19.185465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:19.186074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:19.194873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.195762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:19.196604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.197061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:19.266763 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:19.281124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7458f641-4e82-4cde-a4f1-8fdb2b734e5d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1275 microversion: 2.1 time: 0.100517 Jul 20 09:37:19.291872 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 118/227] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:19 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:19.332896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-19be68f6-aa76-4ccd-bb6a-12f9782bfa9c tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f46ca4c0>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:19.404754 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-19be68f6-aa76-4ccd-bb6a-12f9782bfa9c tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14407780-9045-4f6b-b72c-bee86787847d" status: 200 len: 351 microversion: 2.1 time: 0.076831 Jul 20 09:37:19.405342 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 110/228] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:37:19 2022] GET /compute/v2.1/os-volumes/14407780-9045-4f6b-b72c-bee86787847d => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:19.557103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:19.558390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:19.565252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.565716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:19.566681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.567441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:19.726230 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:19.735645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-31bfd362-13f1-41e3-9aca-76f0b33a9d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.182188 Jul 20 09:37:19.736499 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 119/229] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:19 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:19.931619 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b484575e-8629-4882-8a21-8665c89af43e", "device": "/dev/sdb"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:19.933593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:19.939681 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.940123 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:19.940876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:19.941304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:20.298907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:20.299984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:20.313597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cb52f66c-e6b7-4b9d-918b-02ced190447f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "POST /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382908 Jul 20 09:37:20.316439 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 111/230] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:37:19 2022] POST /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:20.320896 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:20.322610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:20.323699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:20.325563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:20.540109 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:20.548218 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-cb5beced-c9d5-4eee-b406-1736cb8b5e12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.252977 Jul 20 09:37:20.549174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 120/231] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:20 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:20.755396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:20.756238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:20.766716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7a49a123-5e6e-4583-9230-4c43639cdb78 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f45e41f0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:20.772433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:20.772874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:20.773650 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:20.774077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:20.850897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7a49a123-5e6e-4583-9230-4c43639cdb78 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/20acfdf1-f9a9-448c-8cb7-7d67c7984339" status: 200 len: 351 microversion: 2.1 time: 0.087885 Jul 20 09:37:20.851627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 121/232] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:37:20 2022] GET /compute/v2.1/os-volumes/20acfdf1-f9a9-448c-8cb7-7d67c7984339 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:20.864196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c76e7fec-2407-41bc-b3ea-cef69d9e0404 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f4653040>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:20.962346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c76e7fec-2407-41bc-b3ea-cef69d9e0404 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102004 Jul 20 09:37:20.963740 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 122/233] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jul 20 09:37:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:20.978817 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-1d644b04-face-4dfe-a990-76e9044a0224 req-b589dd29-1bca-48fc-b70a-8746bae9aa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408a75a3-c015-49c6-8efc-008016adc618", "tag": "0a05bc8a-3334-4d8e-b551-ad947848f414"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:20.996347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-1d644b04-face-4dfe-a990-76e9044a0224 req-b589dd29-1bca-48fc-b70a-8746bae9aa2b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:20.997071 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-1d644b04-face-4dfe-a990-76e9044a0224 req-b589dd29-1bca-48fc-b70a-8746bae9aa2b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:21.008986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-1d644b04-face-4dfe-a990-76e9044a0224 req-b589dd29-1bca-48fc-b70a-8746bae9aa2b service nova] Creating event network-changed:0a05bc8a-3334-4d8e-b551-ad947848f414 for instance 408a75a3-c015-49c6-8efc-008016adc618 on hv-cinder-82282 Jul 20 09:37:21.014075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-1d644b04-face-4dfe-a990-76e9044a0224 req-b589dd29-1bca-48fc-b70a-8746bae9aa2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043190 Jul 20 09:37:21.014671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 123/234] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:21.020518 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1ce42bbd-0b33-4ad6-afae-308ab2184351 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f47c9790>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.041556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:21.051805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:21.055280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-74a5d022-7eb5-4e75-93ef-6fc828632ee7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.305375 Jul 20 09:37:21.055892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 112/235] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:20 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:21.129774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1ce42bbd-0b33-4ad6-afae-308ab2184351 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.113630 Jul 20 09:37:21.130747 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 124/236] 10.222.0.18 () {58 vars in 1148 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:21.143502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5dbd769-5ca2-45cc-a0ff-7efe93f6b9c5 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f4655700>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.236217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f5dbd769-5ca2-45cc-a0ff-7efe93f6b9c5 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096874 Jul 20 09:37:21.236783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 113/237] 10.222.0.18 () {58 vars in 1133 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:21.247842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6b3c33f0-29fc-4223-b126-228e06b5b331 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f45e4430>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.332478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6b3c33f0-29fc-4223-b126-228e06b5b331 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088237 Jul 20 09:37:21.334276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 125/238] 10.222.0.18 () {58 vars in 1166 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:21.345815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f89e93e5-07c6-4d70-9ece-9d55ca8c7d43 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f45f9820>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.427760 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f89e93e5-07c6-4d70-9ece-9d55ca8c7d43 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085315 Jul 20 09:37:21.428352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 114/239] 10.222.0.18 () {58 vars in 1169 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:21.441990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0b582b92-b8a8-41ec-8675-1bec1c0ae7b0 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f47a3430>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.533780 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0b582b92-b8a8-41ec-8675-1bec1c0ae7b0 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097301 Jul 20 09:37:21.534355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 126/240] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:21.546093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c5a4c3da-5851-4598-b069-f65930792589 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f460b3a0>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.565699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.566444 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:21.573344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:21.573791 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:21.574561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:21.574999 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:21.631250 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c5a4c3da-5851-4598-b069-f65930792589 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089214 Jul 20 09:37:21.631928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 115/241] 10.222.0.18 () {58 vars in 1187 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:21.643098 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cf4622e0-6ed0-44e9-8c81-c4a366349b71 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] Calling method '.version_select at 0x7f81f45f9040>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:21.728476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:21.730480 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cf4622e0-6ed0-44e9-8c81-c4a366349b71 tempest-VolumesTestJSON-279589057 tempest-VolumesTestJSON-279589057-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090916 Jul 20 09:37:21.739420 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 116/242] 10.222.0.18 () {58 vars in 1154 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:21.748119 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e64558e8-0778-4d0a-a2fb-5186f0a6e12a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.185778 Jul 20 09:37:21.759372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 127/243] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:21 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:22.073427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:22.074096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:22.080181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:22.080623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:22.081373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:22.081801 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:22.221136 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:22.229396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b1e0ac0b-32f6-4e2a-ae53-7a980b605be6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.159908 Jul 20 09:37:22.229967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 117/244] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:22 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:22.766040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:22.766776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:22.774067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:22.774511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:22.775258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:22.775711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:22.918899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:22.928227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e50bcea0-61c9-4d60-bc4f-7e5b23fe417e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.165333 Jul 20 09:37:22.928807 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 128/245] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:22 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:23.246784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:23.247610 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:23.254277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:23.254709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:23.256041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:23.256656 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:23.437217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:23.446517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cfc8c080-fbdc-468e-ac8a-f3c31379eabf tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.203681 Jul 20 09:37:23.447104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 118/246] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:23 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:23.944770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:23.945381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:23.953330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:23.954063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:23.955020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:23.955625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:24.160146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:24.168012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5dfec745-f10b-4d49-b4b3-69af6d147956 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.227812 Jul 20 09:37:24.168578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 129/247] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:23 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:24.463543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:24.464143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:24.471131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:24.471597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:24.472347 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:24.472780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:24.612574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:24.621218 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cd60913f-9254-4ebd-bfad-89fc7eb5d482 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.161449 Jul 20 09:37:24.621789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 119/248] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:24 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:25.185449 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:25.186197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:25.194042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:25.194679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:25.195475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:25.195911 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:25.362276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:25.372379 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-317c6d3b-e5f9-48a3-b3c3-5cd2849340ce tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.190807 Jul 20 09:37:25.373256 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 130/249] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:25 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:25.638789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:25.642077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:25.655854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:25.656307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:25.657908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:25.658548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:25.881484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:25.891100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e127b267-ecbd-47da-8629-c2e1e63b7d1a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.256416 Jul 20 09:37:25.892746 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 120/250] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:25 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:26.389842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:26.390445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:26.397268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:26.397707 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:26.398464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:26.399076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:26.591498 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:26.602619 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3d9bb60f-be93-4867-81ea-beaf0830b5d1 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.216270 Jul 20 09:37:26.603327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 131/251] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:26 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:26.909156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:26.909781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:26.917709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:26.918263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:26.918937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:26.919414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:27.101159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:27.109836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9d5ab662-fc0b-43de-a3a3-4d4a05e76afe tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.203855 Jul 20 09:37:27.112124 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 121/252] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:26 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:27.478720 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-c5f6a864-a6cc-4adc-8233-9bbc09b67d18 req-94408a93-1280-4e90-bf84-003af723a802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408a75a3-c015-49c6-8efc-008016adc618", "name": "network-vif-plugged", "status": "completed", "tag": "0a05bc8a-3334-4d8e-b551-ad947848f414"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:27.495035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-c5f6a864-a6cc-4adc-8233-9bbc09b67d18 req-94408a93-1280-4e90-bf84-003af723a802 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:27.495035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-c5f6a864-a6cc-4adc-8233-9bbc09b67d18 req-94408a93-1280-4e90-bf84-003af723a802 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:27.511792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-c5f6a864-a6cc-4adc-8233-9bbc09b67d18 req-94408a93-1280-4e90-bf84-003af723a802 service nova] Creating event network-vif-plugged:0a05bc8a-3334-4d8e-b551-ad947848f414 for instance 408a75a3-c015-49c6-8efc-008016adc618 on hv-cinder-82282 Jul 20 09:37:27.519981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-c5f6a864-a6cc-4adc-8233-9bbc09b67d18 req-94408a93-1280-4e90-bf84-003af723a802 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046583 Jul 20 09:37:27.521517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 132/253] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:27.633890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:27.635078 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:27.646314 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:27.648979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:27.650047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:27.650915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:28.013998 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:28.034770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:28.041394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:28.044502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-967cfa6a-8704-4d00-9f83-4b8514e7f472 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.418793 Jul 20 09:37:28.045085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 122/254] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:27 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:28.128847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:28.132085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:28.140339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:28.140796 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:28.141588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:28.142030 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:28.173343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:28.344193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:28.353027 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7e240d86-100d-47e7-a80b-56c6cce17b22 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.228965 Jul 20 09:37:28.353915 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 133/255] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:28 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:29.064473 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:29.065875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:29.074051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:29.074721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:29.075722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:29.076155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:29.219747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:29.228534 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-09ce2412-85ac-4ae2-844c-62e0f1a74820 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.168373 Jul 20 09:37:29.229111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 123/256] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:29 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:29.370995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:29.371840 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:29.378653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:29.379175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:29.380128 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:29.381237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:29.398904 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:29.598219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:29.605695 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-818fb268-cfe4-426d-84cb-eefbfb60a205 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.238889 Jul 20 09:37:29.606251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 134/257] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:29 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:30.247439 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:30.248343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:30.255590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:30.256043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:30.256899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:30.257332 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:30.398496 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:30.405826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-dc93fac4-096b-4711-8e95-98bb067ced21 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.164026 Jul 20 09:37:30.406383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 124/258] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:30 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:30.622800 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:30.623594 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:30.630738 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:30.631267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:30.632162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:30.632724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:30.794055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:30.806167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c2c598fd-33dd-479c-8d30-b9cffebbf651 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.187103 Jul 20 09:37:30.806775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 135/259] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:30 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:31.423566 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:31.424168 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:31.431381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:31.431822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:31.441229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:31.441840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:31.590039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:31.597487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-79f51313-8c8a-424b-93e1-3cac8426d42d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.178164 Jul 20 09:37:31.598044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 125/260] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:31 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:31.822863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:31.823583 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:31.830344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:31.830798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:31.831577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:31.832089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:31.975659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:31.983267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-17b83b90-07ff-421a-8364-5fe34b1c77ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.164276 Jul 20 09:37:31.983844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 136/261] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:31 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:32.616577 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:32.617209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:32.623846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:32.624289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:32.625050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:32.625506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:32.770996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:32.778797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-53877153-ada6-404f-a9d5-e541e824f99e tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.166652 Jul 20 09:37:32.779400 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 126/262] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:32 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:33.001801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:33.002414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:33.009507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:33.009942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:33.010685 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:33.011104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:33.156658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:33.165094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-cccbb9c4-560c-4cb1-8ef5-ca00bdb4fda9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.167153 Jul 20 09:37:33.165935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 137/263] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:32 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:33.795809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:33.796478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:33.803316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:33.803790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:33.804576 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:33.807930 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:33.951897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:33.960113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5fc2070f-d78d-47e8-9991-52816c3bd2bc tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.168020 Jul 20 09:37:33.960689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 127/264] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:33 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:34.182806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:34.183480 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:34.189875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:34.190318 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:34.191067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:34.191525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:34.472375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:34.480426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-62d1f5de-ce18-4b58-948a-2cdf9de4e984 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.301444 Jul 20 09:37:34.480985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 138/265] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:34 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:34.977503 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:34.978111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:34.985168 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:34.985907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:34.986674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:34.987126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:35.128927 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:35.137496 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7c7be5d2-5d91-4579-a493-6326f7b42aaf tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.163866 Jul 20 09:37:35.138191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 128/266] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:34 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:35.497903 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:35.498499 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:35.505819 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:35.506711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:35.507529 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:35.508198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:35.654298 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:35.663867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4d2971af-fb08-461e-8d53-94ed7730033d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.169708 Jul 20 09:37:35.664434 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 139/267] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:35 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:36.154836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:36.155544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:36.163076 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:36.163555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:36.164324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:36.164753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:36.298357 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:36.305774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-19332834-9279-4fb6-a16a-235bb1d73e6d tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1315 microversion: 2.1 time: 0.154893 Jul 20 09:37:36.306368 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 129/268] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:36 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:36.682476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:36.683751 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:36.691641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:36.692336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:36.694120 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:36.694632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:36.852787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:36.860209 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-be807222-46f3-49d2-b93d-ade075a3fde8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.182496 Jul 20 09:37:36.867940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 140/269] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:36 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:37.323626 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:37.324157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:37.330476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.330921 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.331696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.332122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.482607 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:37.490608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-399eefa7-8bea-4907-9c92-3f89927ee7f0 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1465 microversion: 2.1 time: 0.171070 Jul 20 09:37:37.491165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 130/270] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:37 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:37.529251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:37.529733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:37.535592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.536031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.537533 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.537964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.562330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:37:37.634472 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-de03fbd0-47ff-49b1-ab6d-0d99594eeb12 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "DELETE /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 204 len: 0 microversion: 2.1 time: 0.108643 Jul 20 09:37:37.635047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 141/271] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:37:37 2022] DELETE /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:37:37.643247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:37.643871 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:37.650683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.651119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.651894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.652320 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.780309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:37.788363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d70344f7-e513-4d93-aae0-40fbb2c4a63c tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1471 microversion: 2.1 time: 0.149083 Jul 20 09:37:37.788918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 131/272] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:37 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:37.877267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:37.877984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:37.884942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.885322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:37.886070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:37.886597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:38.015848 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:38.024052 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1befa6e9-ec61-4d50-89df-f62574e2270e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.151002 Jul 20 09:37:38.024624 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 142/273] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:37 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:38.806210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:38.806805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:38.813384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:38.813815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:38.814553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:38.814975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:38.944256 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:38.951739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cb67769c-0154-4e91-be03-0cb063ab1100 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1471 microversion: 2.1 time: 0.150218 Jul 20 09:37:38.952305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 132/274] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:38 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:39.041918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:39.042435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:39.048957 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:39.049401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:39.050154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:39.050589 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:39.183145 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:39.191042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5fc9b195-6864-4074-b4d1-416e6a60a131 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.153429 Jul 20 09:37:39.191900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 143/275] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:39 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:39.970205 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:39.970810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:39.977394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:39.977828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:39.978572 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:39.978996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:39.996942 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:40.110494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:40.118399 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-592ae9c8-1264-43c3-b572-e77ac0c02446 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1471 microversion: 2.1 time: 0.152033 Jul 20 09:37:40.118948 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 133/276] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:39 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:40.208430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:40.209055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:40.211598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:40.217354 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:40.217828 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:40.218538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:40.218965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:40.357272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:40.365469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9685b851-ce8d-4159-b63f-68d24c6548e5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.160322 Jul 20 09:37:40.366122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 144/277] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:40 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:41.137280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:41.139121 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:41.146457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:41.146902 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:41.147741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:41.148210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:41.327373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:41.335048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-167778ca-4b1e-49f8-b25a-4817fc02f6ac tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1471 microversion: 2.1 time: 0.202118 Jul 20 09:37:41.335644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 134/278] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:41 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:41.383244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:41.384257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:41.391372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:41.391821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:41.392582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:41.393020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:41.537630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:41.545311 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a0d8ad74-5c05-4f2b-ac7d-37ddb2ae395f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1523 microversion: 2.1 time: 0.166962 Jul 20 09:37:41.545874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 145/279] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:41 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:42.351648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:42.352244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:42.358526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.358958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.359739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.360161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.497501 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:42.505052 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bb1d18c7-990d-4e5a-9abb-d51bf5c6fff9 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1471 microversion: 2.1 time: 0.158001 Jul 20 09:37:42.505633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 135/280] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:42 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:42.561770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:42.562377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:42.569566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.570014 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.570761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.571185 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.706456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:42.714363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-966f9527-877d-49cc-9130-cecd45db2e2a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1503 microversion: 2.1 time: 0.156307 Jul 20 09:37:42.715238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 146/281] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:42 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:42.730751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:42.731377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:42.737848 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.738367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.739194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:42.739930 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:42.980794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:42.989058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7ef59cd4-b106-42fe-be40-fd6b44ddcf29 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1515 microversion: 2.1 time: 0.262076 Jul 20 09:37:42.990428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 136/282] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:42 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:43.522946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:43.523590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:43.533788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:43.534715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:43.536017 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:43.537965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:43.617316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:43.627146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fd661bd5-dc98-4b03-88ee-a7c22bd59f3a tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1429 microversion: 2.1 time: 0.108902 Jul 20 09:37:43.627914 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 147/283] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:43 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:43.644784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-0a2bc427-a7d3-4e9c-812a-5941c6971920 req-11dfd10c-c470-491a-bdae-0e168091d213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408a75a3-c015-49c6-8efc-008016adc618", "name": "network-vif-deleted", "tag": "0a05bc8a-3334-4d8e-b551-ad947848f414"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:43.650401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:43.656688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-0a2bc427-a7d3-4e9c-812a-5941c6971920 req-11dfd10c-c470-491a-bdae-0e168091d213 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:43.659174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-0a2bc427-a7d3-4e9c-812a-5941c6971920 req-11dfd10c-c470-491a-bdae-0e168091d213 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:43.675233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-0a2bc427-a7d3-4e9c-812a-5941c6971920 req-11dfd10c-c470-491a-bdae-0e168091d213 service nova] Creating event network-vif-deleted:0a05bc8a-3334-4d8e-b551-ad947848f414 for instance 408a75a3-c015-49c6-8efc-008016adc618 on hv-cinder-82282 Jul 20 09:37:43.681875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-0a2bc427-a7d3-4e9c-812a-5941c6971920 req-11dfd10c-c470-491a-bdae-0e168091d213 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040956 Jul 20 09:37:43.683165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 137/284] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:37:44.233627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:44.234101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:44.240461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.240906 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.241653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.242083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.370015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lazy-loading 'services' on Instance uuid 8da36441-0cf4-4086-8faa-5b31b5b44424 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:37:44.485369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:37:44.497090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-af1c6471-2244-4aef-8c7c-c51798658142 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424/os-volume_attachments/b484575e-8629-4882-8a21-8665c89af43e" status: 202 len: 0 microversion: 2.1 time: 0.267247 Jul 20 09:37:44.497680 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 148/285] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:37:44 2022] DELETE /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424/os-volume_attachments/b484575e-8629-4882-8a21-8665c89af43e => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:37:44.568555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:44.568555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:44.570648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.571152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.572263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.572850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.596828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lazy-loading 'flavor' on Instance uuid 69dd79a4-13b6-4962-85c9-ab27f895facb {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:37:44.648734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:44.649428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:44.657743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.658333 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.659332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.661268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.683248 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-942f50f0-e1a9-4b6f-8ad7-2eb6955ae049 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/action" status: 200 len: 32 microversion: 2.1 time: 0.126390 Jul 20 09:37:44.684503 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 138/286] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:37:44 2022] POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 09:37:44.702571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.703723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.704396 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lazy-loading 'fault' on Instance uuid 408a75a3-c015-49c6-8efc-008016adc618 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:37:44.707934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:44.710823 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:44.717541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.717986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.718748 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:44.719378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:44.752640 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35dfd2a073164dac83acbf686ad7fb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d626a45f8a74c748b720ed295079fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:44.760299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9387f5d0-a927-4861-940e-76ddf66420cd tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 200 len: 1305 microversion: 2.1 time: 0.120580 Jul 20 09:37:44.760803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 149/287] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:44 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:44.850863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:44.858336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8139b998-4090-4e74-8d8e-c55cf6092adc tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.168955 Jul 20 09:37:44.858901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 139/288] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:44 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:45.635979 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:45.636624 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:45.642795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.643235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.644018 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.644448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.672035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:37:45.751000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1608bfc4-d3d7-4678-b87c-5516070c18a1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 204 len: 0 microversion: 2.1 time: 0.118543 Jul 20 09:37:45.751748 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 150/289] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:37:45 2022] DELETE /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:37:45.760685 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:45.761433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:45.767616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.768057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.768812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.769237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.778567 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:45.779604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] [instance: 408a75a3-c015-49c6-8efc-008016adc618] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:45.785985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.786439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.787201 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.787656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.803313 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] HTTP exception thrown: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Request method failure captured: Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 HTTP/1.1 Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18zLrKbdVMtvEFGa_A7djO6l-bWgZQgBFXAmnx2SdYmLk6YBaaEqPnpNgmS2JJAibvyC5p2Iy_G_PqGHTRUjENaM9m8tgqihLMKF79bm_5Rja8aWDLiQxXHnEqnM_boPQ3NKhkAXGY1ygEJoEsnKNq-6GSWOLYh8-VETxLP51GrAkRA Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 6d626a45f8a74c748b720ed295079fed Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesNegativeTest-121916658 Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:37:45.805168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6d626a45f8a74c748b720ed295079fed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d626a45f8a74c748b720ed295079fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6d626a45f8a74c748b720ed295079fed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6d626a45f8a74c748b720ed295079fed"}]}] Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesNegativeTest-121916658 Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 6d626a45f8a74c748b720ed295079fed Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesNegativeTest-121916658 Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesNegativeTest-121916658-project Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 35dfd2a073164dac83acbf686ad7fb8b Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesNegativeTest-121916658-project Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. Jul 20 09:37:45.806973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '408a75a3-c015-49c6-8efc-008016adc618'} Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:45.807754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. Jul 20 09:37:45.809038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:45.810060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] Returning 404 to user: Instance 408a75a3-c015-49c6-8efc-008016adc618 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:45.810060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-47b8c7bd-7305-4c69-9b61-2c9e1260ede2 tempest-VolumesNegativeTest-121916658 tempest-VolumesNegativeTest-121916658-project] 10.222.0.18 "GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618" status: 404 len: 111 microversion: 2.1 time: 0.032282 Jul 20 09:37:45.819873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 151/290] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:45 2022] GET /compute/v2.1/servers/408a75a3-c015-49c6-8efc-008016adc618 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:45.875661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:45.876397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:45.890090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.890711 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.892097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:45.892679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:45.954626 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:45.963720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a4c86527-56a5-4912-a611-914f421296e2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1514 microversion: 2.1 time: 0.206735 Jul 20 09:37:45.964430 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 140/291] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:45 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:46.037511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:46.046078 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-95c00241-e758-4b0a-b1cb-a07ea5897128 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.174350 Jul 20 09:37:46.046733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 152/292] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:45 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:46.981277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:46.982015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:46.988529 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:46.988983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:46.989992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:46.990486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:47.065298 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:47.065989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:47.074290 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:47.074901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:47.076002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:47.076648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:47.132627 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:47.140509 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3746ae34-110a-40b8-9a78-fe64999648d2 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1514 microversion: 2.1 time: 0.163055 Jul 20 09:37:47.141325 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 141/293] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:46 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:47.221098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:47.229598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bee2ddfa-3dff-40aa-8926-a0106dff2797 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.169168 Jul 20 09:37:47.230269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 153/294] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:47 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:48.157744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:48.158349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:48.165111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:48.165809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:48.166559 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:48.166982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:48.251082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:48.251487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:48.263026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:48.263527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:48.264302 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:48.264723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:48.311637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:48.320963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0b0ec476-8686-4a75-a84d-af591218bdcb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1514 microversion: 2.1 time: 0.166941 Jul 20 09:37:48.321550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 142/295] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:48 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:48.415546 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:48.423862 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-085c9e0e-204f-46c2-95b9-ce37aca1a600 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.181813 Jul 20 09:37:48.424411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 154/296] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:48 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:49.338134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:49.338794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:49.345363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:49.345802 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:49.346540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:49.346996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:49.440712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:49.441926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:49.448495 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:49.448946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:49.449712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:49.450163 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:49.517173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:49.525462 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-97e4e0b4-ebfa-465e-b5b8-ded711fd6ffb tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 200 len: 1514 microversion: 2.1 time: 0.191135 Jul 20 09:37:49.526288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 143/297] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:49 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:49.592708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:49.601273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-14c55e07-82f1-49da-adbe-93ba0fa2879c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.164373 Jul 20 09:37:49.601828 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 155/298] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:49 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:37:49.931645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-21aaaef2-b08a-4510-8cd2-1429853e400d req-dfab5e4c-9309-48c8-a96f-cd7798813123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da36441-0cf4-4086-8faa-5b31b5b44424", "name": "network-vif-deleted", "tag": "858a2557-dd95-4202-9ad4-6f69f24ea78a"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:37:49.939939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-21aaaef2-b08a-4510-8cd2-1429853e400d req-dfab5e4c-9309-48c8-a96f-cd7798813123 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:49.940404 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-21aaaef2-b08a-4510-8cd2-1429853e400d req-dfab5e4c-9309-48c8-a96f-cd7798813123 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:49.952158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-21aaaef2-b08a-4510-8cd2-1429853e400d req-dfab5e4c-9309-48c8-a96f-cd7798813123 service nova] Creating event network-vif-deleted:858a2557-dd95-4202-9ad4-6f69f24ea78a for instance 8da36441-0cf4-4086-8faa-5b31b5b44424 on hv-cinder-82282 Jul 20 09:37:49.956975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-21aaaef2-b08a-4510-8cd2-1429853e400d req-dfab5e4c-9309-48c8-a96f-cd7798813123 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029061 Jul 20 09:37:49.958906 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 144/299] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:37:50.542945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:50.543570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: 8da36441-0cf4-4086-8faa-5b31b5b44424] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:50.550284 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:50.550719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:50.552149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:50.552616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:50.565830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] HTTP exception thrown: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Request method failure captured: Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 HTTP/1.1 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yZjtUV2O-ZiA0D5G_3IqeRsdll5hmswDm2cB7I_1JK_zYbxQ7Q6rM5wycnHHx7HJ39v7VpVpp3ofDYGlNTf4Zb1es888GxnEGBE3X-AhYsmzdUY-27LcXwjfOdqrbhzvWUWfPKdmrTQ0Qd0cGR0gTwuaDYDflX-sCxaJgtWvXCHCI Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 298d7611d92a47fd94dd66c8ff10a7f3 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:37:50.567919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/298d7611d92a47fd94dd66c8ff10a7f3"}]}] Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 298d7611d92a47fd94dd66c8ff10a7f3 Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesSnapshotTestJSON-430022248-project Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 7ed56ed8be784927917986375a76df4c Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesSnapshotTestJSON-430022248-project Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. Jul 20 09:37:50.569389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '8da36441-0cf4-4086-8faa-5b31b5b44424'} Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:37:50.570203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. Jul 20 09:37:50.571577 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:37:50.572935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Returning 404 to user: Instance 8da36441-0cf4-4086-8faa-5b31b5b44424 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:37:50.572935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-319b6c92-f240-4e40-bced-352a9e458d65 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424" status: 404 len: 111 microversion: 2.1 time: 0.030521 Jul 20 09:37:50.572935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 156/300] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:50 2022] GET /compute/v2.1/servers/8da36441-0cf4-4086-8faa-5b31b5b44424 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:37:50.620117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:50.620814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:50.627245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:50.627990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:50.628781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:50.629216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:50.804208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:50.815781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-60fe78c4-4c8f-4cce-ab3d-a655fe988367 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.199984 Jul 20 09:37:50.817344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 145/301] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:50 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:51.834230 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:51.834845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:51.841821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:51.842270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:51.843116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:51.843622 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:51.980636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:51.988837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-688174b4-c070-4607-b481-eac71985fd71 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.159030 Jul 20 09:37:51.989657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 157/302] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:51 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:53.005942 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:53.006543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:53.013927 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:53.014383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:53.015154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:53.015702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:53.157194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:53.165425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6b6a3708-de23-4405-a1e2-b277b90bcef7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.163073 Jul 20 09:37:53.165999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 146/303] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:53 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:54.182623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:54.183189 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:54.189859 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:54.190296 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:54.191042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:54.191617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:54.326143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:54.334192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a8e54a76-bd44-4de0-9172-a26ad9e790f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.155606 Jul 20 09:37:54.334752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 158/304] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:54 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:55.351100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:55.351721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:55.358720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:55.359164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:55.359964 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:55.360408 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:55.499619 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:55.507696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a92037bc-71aa-4f7f-a4ff-42cb44c787c9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.160439 Jul 20 09:37:55.508251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 147/305] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:55 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:56.525153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:56.525781 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:56.532303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:56.532740 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:56.533475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:56.533899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:56.670128 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:56.678083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c39b7b08-338c-4a8b-816f-34d4a88c3569 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.156754 Jul 20 09:37:56.678650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 159/306] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:56 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:57.696186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:57.696707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:57.702654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:57.703092 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:57.703880 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:57.704305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:57.841969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:57.850256 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3ce888ee-07ce-47bb-abb1-62d6a43ea75c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.159029 Jul 20 09:37:57.850810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 148/307] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:57 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:37:58.867803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:37:58.868409 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:37:58.875011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:58.875496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:58.876258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:37:58.876689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:37:59.008448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:37:59.015982 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8e743f84-da35-4e63-94a4-34249806dba0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.152683 Jul 20 09:37:59.016540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 160/308] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:37:58 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:00.033600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:00.034200 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:00.041710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:00.042290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:00.042906 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:00.043352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:00.062895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:00.183492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:00.190906 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4331cda2-2523-4e2b-85f6-d8072ed2f1dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.161194 Jul 20 09:38:00.192129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 149/309] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:00 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:00.574576 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:00.575225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:00.581949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:00.582384 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:00.583415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:00.583842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:00.606163 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2fad4c56-359c-427f-9ac5-09bdf55f9761 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/ips" status: 200 len: 145 microversion: 2.1 time: 0.035505 Jul 20 09:38:00.606702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 161/310] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:38:00 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:01.209428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:01.209971 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:01.217103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:01.217551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:01.218338 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:01.218778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:01.356843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:01.364490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b86b7ada-2303-4164-8023-2eb77df577d0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.159348 Jul 20 09:38:01.365244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 150/311] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:01 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:02.385339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:02.386677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:02.397670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:02.399627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:02.401439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:02.402402 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:02.580041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1802513949", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "networks": [{"uuid": "62d7b8d9-8d7e-4751-b1cf-35e38e741657"}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:02.591752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:02.600502 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-84b08085-b8cb-41f4-a693-a6100ff9e91a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.219516 Jul 20 09:38:02.601060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 162/312] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:02 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:02.634766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] validate_networks() for [('62d7b8d9-8d7e-4751-b1cf-35e38e741657', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:38:02.998432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:38:02.998851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:38:02.999372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:38:02.999851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:38:03.000232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:38:03.010258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.010694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.011682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.012045 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.028308 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Getting quotas for project 298d7611d92a47fd94dd66c8ff10a7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:38:03.032395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Getting quotas for user 7ed56ed8be784927917986375a76df4c and project 298d7611d92a47fd94dd66c8ff10a7f3. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:38:03.044715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:38:03.046958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:38:03.094392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d7c4c271-e2f9-4f53-bce1-aebc20755491 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518332 Jul 20 09:38:03.095163 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 151/313] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:38:03.108776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7a41a32f-35ec-478c-b5b1-a22a8a3e3090 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:03.109586 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7a41a32f-35ec-478c-b5b1-a22a8a3e3090 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:03.168253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7a41a32f-35ec-478c-b5b1-a22a8a3e3090 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:03.174784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7a41a32f-35ec-478c-b5b1-a22a8a3e3090 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1219 microversion: 2.1 time: 0.071666 Jul 20 09:38:03.175553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 163/314] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:03 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:03.482055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "995cf474-c7ef-4213-9a51-90910b4c2cea"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:03.483205 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:03.489343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.489784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.490569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.490995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.617452 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:03.618302 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:03.626242 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.626693 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.627497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:03.627949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:03.797949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:03.806465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9fd70a16-abeb-486d-9f42-d2da39c3fabc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329930 Jul 20 09:38:03.807241 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-992f2688-42fc-45fd-b25f-72b699299af3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.193724 Jul 20 09:38:03.807407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 152/315] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:38:03 2022] POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:03.812289 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 164/316] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:03 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:04.194472 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:04.195169 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:04.202277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:04.202713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:04.203516 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:04.203940 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:04.268470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:04.278260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2078d508-e6b7-4d1a-8178-55010e177e81 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1271 microversion: 2.1 time: 0.088777 Jul 20 09:38:04.278993 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 153/317] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:04 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:04.830259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:04.831664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:04.839349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:04.839792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:04.840715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:04.841111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:04.997596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:05.006745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-561674f4-c3e9-4e8e-80df-78b332c58772 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.181142 Jul 20 09:38:05.007712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 165/318] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:04 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:05.296712 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:05.297256 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:05.304847 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:05.305285 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:05.306043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:05.306469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:05.370366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:05.377908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e3b3718d-7411-48ee-a203-00ba10196b73 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1277 microversion: 2.1 time: 0.085062 Jul 20 09:38:05.378429 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 154/319] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:05 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:06.023415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:06.024051 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:06.030646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:06.031093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:06.032087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:06.032684 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:06.040036 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:06.166956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:06.174573 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fb4337f7-efc3-4867-b53e-26b82e36e5c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.155279 Jul 20 09:38:06.175153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 166/320] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:06 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:06.395917 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:06.396598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:06.403312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:06.403753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:06.404509 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:06.404937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:06.625025 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e6eec4a6-75a6-4a96-8847-b61052a1344f req-b56e132c-da1a-4f48-a4a6-95ee6e14f319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d051e821-9e2a-41b3-959b-5dae072de01e", "tag": "05b33b7b-829b-4473-aa2c-bbd829bd3e23"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:06.633889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e6eec4a6-75a6-4a96-8847-b61052a1344f req-b56e132c-da1a-4f48-a4a6-95ee6e14f319 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:06.634480 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e6eec4a6-75a6-4a96-8847-b61052a1344f req-b56e132c-da1a-4f48-a4a6-95ee6e14f319 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:06.636806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:06.644535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eec5ef06-fe9d-4f5c-bfad-a9d6b827d4aa tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.253197 Jul 20 09:38:06.645461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 155/321] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:06 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:06.651173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e6eec4a6-75a6-4a96-8847-b61052a1344f req-b56e132c-da1a-4f48-a4a6-95ee6e14f319 service nova] Creating event network-changed:05b33b7b-829b-4473-aa2c-bbd829bd3e23 for instance d051e821-9e2a-41b3-959b-5dae072de01e on hv-cinder-82282 Jul 20 09:38:06.656473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e6eec4a6-75a6-4a96-8847-b61052a1344f req-b56e132c-da1a-4f48-a4a6-95ee6e14f319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Jul 20 09:38:06.657064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 167/322] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:38:07.193162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:07.193771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:07.200815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.201281 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.202224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.202695 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.436616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:07.448514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-04d5a946-c42f-4d08-87cf-672b72a62c63 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1501 microversion: 2.1 time: 0.260056 Jul 20 09:38:07.449242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 156/323] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:07 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:07.466882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d489193b-15dd-448d-9d59-a540478f211c"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:07.468083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:07.475084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.475550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.476492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.477090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.501706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] HTTP exception thrown: Cannot 'attach_volume' instance 69dd79a4-13b6-4962-85c9-ab27f895facb while it is in vm_state rescued Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Request method failure captured: Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/os-volume_attachments HTTP/1.1 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 74 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yApCWSG7CZNcKwNsvojyCIz8Qj1uogJ1jRxT7bKIadu7R1lE674yOpVPifg7pqW_SfO99g-cVxOe0F8X7COFTPA0dP4ar7VR930nbNiJOhl57Q_DM0aobdI62yLm65t_ck13d8aGzH6OEIK5kMijKZi720Risf_XZ_lJy2XfTl1uM Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:38:07.504578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}] Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: bc74ebac003a4f828fdb44db6dc42887 Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {"volumeAttachment": {"volumeId": "d489193b-15dd-448d-9d59-a540478f211c"}} Jul 20 09:38:07.506268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Cannot 'attach_volume' instance 69dd79a4-13b6-4962-85c9-ab27f895facb while it is in vm_state rescued Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'server_id': '69dd79a4-13b6-4962-85c9-ab27f895facb', 'body': {'volumeAttachment': {'volumeId': 'd489193b-15dd-448d-9d59-a540478f211c'}}} Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:38:07.507144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 69dd79a4-13b6-4962-85c9-ab27f895facb while it is in vm_state rescued Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:38:07.508351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:38:07.509464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:38:07.509464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:38:07.509464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 69dd79a4-13b6-4962-85c9-ab27f895facb while it is in vm_state rescued Jul 20 09:38:07.509464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:07.510785 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Returning 409 to user: Cannot 'attach_volume' instance 69dd79a4-13b6-4962-85c9-ab27f895facb while it is in vm_state rescued {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:38:07.511857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-329c4975-8c64-4e22-a36d-4b84322850f4 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049850 Jul 20 09:38:07.512630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 168/324] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:38:07 2022] POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:38:07.523059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:07.523634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:07.530820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.531744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.532680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.533119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.612937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fce25417-3be9-44a5-aa99-d26844699d28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/action" status: 202 len: 0 microversion: 2.1 time: 0.094312 Jul 20 09:38:07.613865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 157/325] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:38:07 2022] POST /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:38:07.624080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:07.625367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:07.633070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.633517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.634319 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.634744 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.662333 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:07.662807 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:07.669680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.670154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.670948 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:07.671409 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:07.813689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:07.821096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:07.824677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cb95a27f-ffe4-4981-9931-23f883f248cc tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.167588 Jul 20 09:38:07.825409 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 158/326] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:07 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:07.829557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-53b678e8-3ea1-45d6-920c-2b5dd11dd1f6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.211661 Jul 20 09:38:07.830380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 169/327] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:07 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:08.850130 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:08.852188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:08.853340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:08.855267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:08.868260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:08.871786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:08.872147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:08.872806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:08.873792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:08.874864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:08.875946 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:08.876837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:09.026247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:09.033801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-709d7730-01fd-4f68-9424-8afa325ca37b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.188856 Jul 20 09:38:09.034376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 170/328] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:08 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:09.345657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:09.353000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4794fef1-1a1f-459d-87f8-d2e770d67ec1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.513779 Jul 20 09:38:09.353592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 159/329] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:08 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:10.052794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:10.053468 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:10.060716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:10.061302 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:10.062190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:10.062627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:10.197963 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:10.205469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ccd83aee-902f-44cb-ab13-6460ee04cfec tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.157367 Jul 20 09:38:10.206016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 171/330] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:10 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:10.369803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:10.370464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:10.376943 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:10.377382 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:10.378122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:10.378550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:10.510468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:10.518022 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-65fb6ed5-33ed-4f81-be9a-915ca724221f tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.152055 Jul 20 09:38:10.518726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 160/331] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:10 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:11.222837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:11.223654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:11.226227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:11.231524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:11.231972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:11.232735 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:11.233189 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:11.366912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:11.374396 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ea5c34e7-1e52-4cac-ab54-3ad9a608b548 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.155422 Jul 20 09:38:11.374958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 172/332] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:11 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:11.534702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:11.535319 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:11.542001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:11.542441 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:11.543190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:11.543644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:11.672229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:11.680272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-19832280-a2bb-4a6d-9e0d-4b42b8f7c981 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.149482 Jul 20 09:38:11.680823 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 161/333] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:11 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:12.391261 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:12.391828 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:12.399083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:12.399559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:12.400325 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:12.400755 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:12.537689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:12.545468 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5454ad1b-4bc9-409d-8924-f9be884a1609 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.158181 Jul 20 09:38:12.546032 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 173/334] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:12 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:12.697143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:12.697661 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:12.704135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:12.704567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:12.705305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:12.705732 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:12.836020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:12.843233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-77c23703-ca6f-449c-a12f-61b024f6a91c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.150082 Jul 20 09:38:12.843820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 162/335] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:12 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:13.562880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:13.564295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:13.566553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:13.573717 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:13.574157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:13.575005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:13.575462 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:13.736144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:13.744690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1da1dc90-5407-4b19-b573-9b17cc9810d5 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1509 microversion: 2.1 time: 0.185768 Jul 20 09:38:13.745264 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 174/336] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:13 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:13.861457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:13.862250 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:13.865153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:13.866002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:13.867428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:13.878086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:13.879143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:13.879986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:13.881703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:14.044586 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:14.056029 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4a79a1ff-829e-4628-89a2-3f7ea7bc98db tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.199556 Jul 20 09:38:14.056621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 163/337] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:13 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:14.465633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-582c2ec1-e70b-49cf-b322-62323acba2e7 req-d7760b33-3748-4bd0-807c-7a50e740f601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d051e821-9e2a-41b3-959b-5dae072de01e", "name": "network-vif-plugged", "status": "completed", "tag": "05b33b7b-829b-4473-aa2c-bbd829bd3e23"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:14.483524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-582c2ec1-e70b-49cf-b322-62323acba2e7 req-d7760b33-3748-4bd0-807c-7a50e740f601 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:14.484313 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-582c2ec1-e70b-49cf-b322-62323acba2e7 req-d7760b33-3748-4bd0-807c-7a50e740f601 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:14.501933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-582c2ec1-e70b-49cf-b322-62323acba2e7 req-d7760b33-3748-4bd0-807c-7a50e740f601 service nova] Creating event network-vif-plugged:05b33b7b-829b-4473-aa2c-bbd829bd3e23 for instance d051e821-9e2a-41b3-959b-5dae072de01e on hv-cinder-82282 Jul 20 09:38:14.510320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-582c2ec1-e70b-49cf-b322-62323acba2e7 req-d7760b33-3748-4bd0-807c-7a50e740f601 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050976 Jul 20 09:38:14.510933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 175/338] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:14.762660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:14.763264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:14.769830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:14.770269 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:14.771128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:14.771587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:14.789900 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:14.912542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:14.920945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9f64d95a-2187-438b-b1ac-9898ff7a37a3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1515 microversion: 2.1 time: 0.162097 Jul 20 09:38:14.921513 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 164/339] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:14 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:15.074582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:15.075497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:15.082446 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:15.082982 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:15.083964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:15.084464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:15.239098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:15.246794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6816d999-c153-4819-b96f-c57707a80e9e tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.176472 Jul 20 09:38:15.247397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 176/340] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:15 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:16.170594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:16.171156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:16.178377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:16.178815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:16.179583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:16.180001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:16.202662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3dbaac76-c39c-4340-a836-5febdc6dfaea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/ips" status: 200 len: 152 microversion: 2.20 time: 0.037074 Jul 20 09:38:16.203209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 165/341] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jul 20 09:38:16 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:38:16.265418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:16.266048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:16.273681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:16.274151 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:16.274990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:16.275455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:16.415618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:16.424514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-446da977-e92a-4f51-93b5-d09da7cf4be5 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.162928 Jul 20 09:38:16.425256 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 177/342] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:16 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:17.441510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:17.442264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:17.449581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:17.450253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:17.451307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:17.451832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:17.584535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:17.592528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7d42544d-6419-40b8-8bd0-b8aa210bf11c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.155169 Jul 20 09:38:17.593176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 166/343] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:17 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:18.387769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6ee85945-c0d2-4ee1-9d68-911829493ec8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: .version_select at 0x7f81f45e44c0>, body: {"keypair": {"name": "tempest-keypair-95979179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr9Z2wEnpabQ3rN86M1JCluiIRXy4a3VpPn6v2OmRkPmoKUlhJdGzfJlt+BJcnAR0HYUllVu25eacbVDGsK8lvu/ZkVtxizr2XR21PEOPAoY+vraohpc4uikE61qMvUxg=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:18.403741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6ee85945-c0d2-4ee1-9d68-911829493ec8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for project 13b4839566df4751bfde1f4975cdcb78. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:38:18.407474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6ee85945-c0d2-4ee1-9d68-911829493ec8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for user bc74ebac003a4f828fdb44db6dc42887 and project 13b4839566df4751bfde1f4975cdcb78. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:38:18.428603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6ee85945-c0d2-4ee1-9d68-911829493ec8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044678 Jul 20 09:38:18.429202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 178/344] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:38:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:18.609556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:18.610437 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:18.618417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:18.619201 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:18.620008 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:18.620639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:18.769220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ee566e6a-91a6-4481-90a9-6eabfcea397f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:18.781185 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ee566e6a-91a6-4481-90a9-6eabfcea397f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:18.781941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ee566e6a-91a6-4481-90a9-6eabfcea397f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:18.823064 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:18.832287 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-54c9160a-ef27-46a0-8e8f-a89a9041e5ec tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.225846 Jul 20 09:38:18.833293 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 167/345] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:18 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:18.844545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ee566e6a-91a6-4481-90a9-6eabfcea397f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Going to try to stop instance {{(pid=124373) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 09:38:18.888560 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ee566e6a-91a6-4481-90a9-6eabfcea397f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action" status: 202 len: 0 microversion: 2.1 time: 0.123080 Jul 20 09:38:18.889357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 179/346] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:38:18 2022] POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:38:18.898964 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:18.899917 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:18.907116 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:18.907853 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:18.908854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:18.911448 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.116960 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:19.125642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cfc34408-db87-4213-891e-6552c6cc4121 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.232264 Jul 20 09:38:19.126313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 168/347] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:18 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:19.150429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:19.150960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:19.157098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.157534 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.158279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.158705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.181113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lazy-loading 'flavor' on Instance uuid 449aaf77-3ec6-4163-bc11-ce226c2ca23d {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:38:19.521058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-213f40a9-1ddb-4951-82f0-2936fa6fca60 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/action" status: 202 len: 0 microversion: 2.20 time: 0.374786 Jul 20 09:38:19.522110 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 180/348] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jul 20 09:38:19 2022] POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:38:19.530905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:19.531620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:19.540049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.540752 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.541796 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.542223 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.775179 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:19.788634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:19.790583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:19.791878 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9ba9f952-c774-4bf8-a09c-e8734cab7756 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.265799 Jul 20 09:38:19.792510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 169/349] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:19 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:19.853644 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:19.856114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:19.863613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.864063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.864956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:19.865367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:19.970324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-221389639", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b536439e-ad65-4ab6-9df1-5521403416c7"}], "security_groups": [{"name": "tempest-securitygroup--68905092"}], "key_name": "tempest-keypair-95979179", "user_data": "}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:20.010124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.018102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5709603f-73bb-4fb2-80e8-0178914ac9d1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.168823 Jul 20 09:38:20.019427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 181/350] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:19 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:20.072320 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] validate_networks() for [('b536439e-ad65-4ab6-9df1-5521403416c7', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:38:20.142702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:20.143327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:20.149892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.150335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.151088 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.151545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.170441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:20.286197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.294362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-be6c6a0e-48e4-4779-b610-850fd2b440f9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.155509 Jul 20 09:38:20.294923 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 182/351] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:20 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:20.445769 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:38:20.446181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:38:20.446774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:38:20.447172 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:38:20.447605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:38:20.458249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.458681 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.459489 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.459912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.476352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:38:20.480109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Getting quotas for user bc74ebac003a4f828fdb44db6dc42887 and project 13b4839566df4751bfde1f4975cdcb78. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:38:20.493658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:38:20.495904 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:38:20.544209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d2727224-8763-40b6-a1ab-73dc19b6f072 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.578046 Jul 20 09:38:20.544767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 170/352] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:38:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 09:38:20.554627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f20c2825-c84c-4079-9229-659312a5f9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:20.555236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f20c2825-c84c-4079-9229-659312a5f9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:20.609738 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f20c2825-c84c-4079-9229-659312a5f9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.618802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f20c2825-c84c-4079-9229-659312a5f9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1243 microversion: 2.1 time: 0.067888 Jul 20 09:38:20.619475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 183/353] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:20 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1243 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:20.814728 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:20.816251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:20.834103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.834550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.835335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:20.835767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:20.972351 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.980208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.981713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:20.982861 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-237d9d78-401d-4f85-8f05-37b0810283dd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.173603 Jul 20 09:38:20.983432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 171/354] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:20 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:21.035527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:21.036118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:21.042308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.042745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.043515 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.043941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.174332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:21.183064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c4635442-0396-4225-ad6e-50761741cd3b tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1319 microversion: 2.1 time: 0.151459 Jul 20 09:38:21.183639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 184/355] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:21 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:21.311830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:21.312467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:21.318462 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.318907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.319686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.320120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.451064 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:21.459588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-777ec0b6-8e0e-4e46-9507-014872204dfa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.151646 Jul 20 09:38:21.460147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 172/356] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:21 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:21.636350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:21.636956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:21.643458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.644394 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.645137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:21.645566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:21.707179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:21.714714 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ab5dbe90-7963-4d7f-9541-690ea2c5e9d7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1247 microversion: 2.1 time: 0.082178 Jul 20 09:38:21.715278 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 185/357] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:21 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:22.001814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:22.002386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:22.009518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.009958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.010864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.011354 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.146584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.154337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.155913 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.157150 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c57d302b-eb9e-4cc5-be57-15e84628a375 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.159287 Jul 20 09:38:22.157900 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 173/358] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:21 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:22.200122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:22.200729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:22.207521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.207969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.208724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.209186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.340812 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.348774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a3381334-df72-4b6b-9c72-5f25c569d577 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1507 microversion: 2.1 time: 0.152497 Jul 20 09:38:22.349335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 186/359] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:22 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:22.365209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df5e16cd-f481-4439-a81d-e4798ae485b3", "device": "/dev/sdb"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:22.366390 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:22.372389 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.372836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.373584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.374011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.477321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:22.477920 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:22.484222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.484726 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.485675 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.485864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.626014 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.635237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c60439d4-969f-4877-973b-0ee8bc17bafa tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.161753 Jul 20 09:38:22.641614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 187/360] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:22 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:22.661081 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-31cce373-44be-4d3d-9af9-6e6363bd3ba1 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "POST /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299949 Jul 20 09:38:22.661706 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 174/361] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:38:22 2022] POST /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:22.731904 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:22.732487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:22.739539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.739985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.740758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:22.741173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:22.808918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:22.817082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-14d97b34-ab1e-4281-bdce-cdb486d41bc2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1295 microversion: 2.1 time: 0.088785 Jul 20 09:38:22.818003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 188/362] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:22 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:23.180806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:23.181373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:23.189224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.190934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:23.192002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.192596 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:23.428977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:23.438995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:23.441348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:23.442745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1a4dccd6-6f96-4e82-ba7b-638aee349fdf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.268393 Jul 20 09:38:23.443484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 175/363] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:23 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:23.660486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:23.661141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:23.667681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.668124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:23.668878 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.669303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:23.813627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:23.822498 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6e96739a-77c6-43ef-90d2-d78327646b9a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.166458 Jul 20 09:38:23.823498 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 189/364] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:23 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:23.836112 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:23.836829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:23.849470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.849998 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:23.851001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:23.851600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:24.101947 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:24.109388 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ac049ff6-99d5-4d67-bfde-861c3b7eb9a8 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.277778 Jul 20 09:38:24.109875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 176/365] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:23 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:24.461355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:24.462245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:24.469087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:24.469803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:24.470741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:24.471348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:24.587407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-46f4bcbe-9dfa-4109-808a-5a04dbe3f3de req-233a844d-e250-4038-b894-998bee4e03c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:24.597328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-46f4bcbe-9dfa-4109-808a-5a04dbe3f3de req-233a844d-e250-4038-b894-998bee4e03c3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:24.597714 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-46f4bcbe-9dfa-4109-808a-5a04dbe3f3de req-233a844d-e250-4038-b894-998bee4e03c3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:24.622781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-46f4bcbe-9dfa-4109-808a-5a04dbe3f3de req-233a844d-e250-4038-b894-998bee4e03c3 service nova] Creating event network-changed:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:38:24.628632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-46f4bcbe-9dfa-4109-808a-5a04dbe3f3de req-233a844d-e250-4038-b894-998bee4e03c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046238 Jul 20 09:38:24.629625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 177/366] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:38:24.650302 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:24.660281 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:24.661882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:24.663949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-da36e53d-5d0c-4676-bdab-43b5c69c08ce tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.206514 Jul 20 09:38:24.664965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 190/367] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:24 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:24.842363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:24.843190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:24.849649 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:24.849993 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:24.850741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:24.851164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:25.075006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:25.083369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c703a2ec-21b7-4582-816f-2a27269fba2a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.245173 Jul 20 09:38:25.083938 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 178/368] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:24 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:25.129327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:25.129972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:25.136913 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:25.137362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:25.138122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:25.138553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:25.273268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:25.281622 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-695718d3-ad5c-4689-9ade-52f712ebcbff tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.157460 Jul 20 09:38:25.282192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 191/369] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:25 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:25.682689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:25.683315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:25.689640 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:25.690174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:25.691628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:25.692057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:25.824240 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:25.832721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:25.834254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:25.835407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d0a029ef-e5ba-4121-8690-8059bc9b3849 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156842 Jul 20 09:38:25.835949 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 179/370] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:25 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:26.101352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:26.101943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:26.107977 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.108414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.109149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.109571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.246811 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:26.254934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3f43e9f8-36a4-459a-8b2c-0555313f6ab1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.158418 Jul 20 09:38:26.255756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 192/371] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:26 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:26.299023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:26.300184 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:26.306086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.306526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.307265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.307716 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.436682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:26.444190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7f9fd7b0-bd5a-4a4e-8ce5-b71e39099a6c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.148988 Jul 20 09:38:26.444748 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 180/372] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:26 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:26.853291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:26.854002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:26.860126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.860597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.861335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:26.861757 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:26.994143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:27.001995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:27.004120 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:27.005279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-24dfcd95-1608-48ec-8ee6-831d1d466ffd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156033 Jul 20 09:38:27.005809 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 193/373] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:26 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:27.272623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:27.273270 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:27.279922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:27.280358 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:27.281123 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:27.281543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:27.299907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:27.410505 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:27.418597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-123bc2e5-ee5e-4942-b456-6210336f2b83 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.149857 Jul 20 09:38:27.419160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 181/374] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:27 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:27.460988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:27.461594 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:27.468031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:27.468480 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:27.469231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:27.469661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:27.599770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:27.607030 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8efe46c4-6c86-430d-a8c4-f646dc499572 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.149829 Jul 20 09:38:27.607808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 194/375] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:27 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:28.023402 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:28.024007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:28.030026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.030467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.031212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.031669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.164662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:28.172466 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:28.173983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:28.175765 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-05219842-57b6-45c2-aa85-22429621eb74 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156312 Jul 20 09:38:28.176298 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 182/376] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:28 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:28.436321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:28.436926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:28.443105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.443580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.444336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.444839 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.572786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:28.581297 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-17b26175-12fe-445e-af91-b0a6626391bc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.148235 Jul 20 09:38:28.581884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 195/377] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:28 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:28.623274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:28.623897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:28.631274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.631773 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.632529 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:28.632962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:28.760005 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:28.768140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2e274da6-d28b-4d47-ba8c-e9c6665ce79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.148592 Jul 20 09:38:28.769257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 183/378] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:28 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:29.194390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:29.195002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:29.200899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.201334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.202066 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.202490 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.343624 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:29.352235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:29.353753 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:29.354910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-48eb964d-155d-4269-8476-6ec53e2af041 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.165030 Jul 20 09:38:29.355497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 196/379] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:29 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:29.601557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:29.602047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:29.609665 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.610499 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.611622 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.614566 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.771417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:29.779532 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-23ab02b8-96b0-43a7-b2f2-4f0b6841a4b7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.184792 Jul 20 09:38:29.780106 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 184/380] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:29 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:29.786664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:29.787543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:29.794437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.794883 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.795666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:29.796091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:29.934484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:29.942907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a5337cae-ddde-4ced-8367-09b311cc34d2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.161286 Jul 20 09:38:29.943571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 197/381] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:29 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:30.375113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:30.376054 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:30.384635 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.385598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.386627 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.387410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.466790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:30.488577 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:30.563415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-15609773-129c-404a-b7be-94e11c0b5a2f req-e9c18aa6-e8b1-4a0b-8dd2-762316aa31c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "name": "network-vif-plugged", "status": "completed", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:30.572730 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-15609773-129c-404a-b7be-94e11c0b5a2f req-e9c18aa6-e8b1-4a0b-8dd2-762316aa31c7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.573351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-15609773-129c-404a-b7be-94e11c0b5a2f req-e9c18aa6-e8b1-4a0b-8dd2-762316aa31c7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.589834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-15609773-129c-404a-b7be-94e11c0b5a2f req-e9c18aa6-e8b1-4a0b-8dd2-762316aa31c7 service nova] Creating event network-vif-plugged:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:38:30.595030 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-15609773-129c-404a-b7be-94e11c0b5a2f req-e9c18aa6-e8b1-4a0b-8dd2-762316aa31c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035687 Jul 20 09:38:30.596163 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 198/382] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:38:30.714617 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:30.722828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:30.725151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:30.726369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a3f9c87e-bc5f-469d-9213-78e6647ef700 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.356301 Jul 20 09:38:30.737694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 185/383] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:30 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:30.794993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:30.800126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:30.800823 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:30.807527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.808207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.808968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.809397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.940908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:30.948817 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-af9bd07a-547c-4ead-b390-2fd3fb55d07a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.154735 Jul 20 09:38:30.949389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 199/384] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:30 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:30.960316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:30.960910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:30.966866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.967335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:30.968087 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:30.968514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:31.094792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:31.102102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-313b99c2-eca7-4abc-8845-c4ce433aabac tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.145617 Jul 20 09:38:31.102658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 186/385] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:30 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:31.745254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:31.745865 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:31.755847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:31.756366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:31.757047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:31.757476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:31.942838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:31.946993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:31.952885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:31.955151 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:31.956649 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8476a0f5-2adb-42db-87c3-6f611424c7ec tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.215151 Jul 20 09:38:31.957215 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 200/386] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:31 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:31.966424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:31.966996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:31.975053 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:31.975548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:31.976312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:31.976741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:32.119506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:32.120330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:32.123747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:32.126863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:32.127430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:32.128844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:32.129290 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:32.132776 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c4a59b30-8142-4083-a282-664247944c1a tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.170126 Jul 20 09:38:32.133466 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 187/387] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:31 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:32.273543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:32.282579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a57b585b-1913-4472-9744-b243fb99dfe0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.167789 Jul 20 09:38:32.283611 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 201/388] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:32 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:32.978073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:32.978711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:32.985149 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:32.985611 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:32.986345 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:32.986922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:33.112815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:33.120709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:33.122207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:33.123377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-02b22966-065b-494c-b73e-50e068d17768 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.149297 Jul 20 09:38:33.124126 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 188/389] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:32 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:33.151057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:33.151688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:33.158137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:33.158607 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:33.159380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:33.159813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:33.287447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:33.295570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3ce53ba1-7f5b-4bd3-8597-88d72ebb5ccc tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.148281 Jul 20 09:38:33.296138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 202/390] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:33 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:33.300819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:33.301427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:33.307391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:33.307834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:33.308588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:33.309021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:33.438088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:33.446732 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5dbfff23-f554-4792-a262-8cc6599f518c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.150130 Jul 20 09:38:33.447316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 189/391] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:33 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:34.141985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:34.142623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:34.148983 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.149434 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.150218 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.150650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.282037 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:34.290806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:34.292350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:34.293510 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-45d9e7cf-ee46-4d69-a808-0e6e50e3c15e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.155380 Jul 20 09:38:34.294058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 203/392] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:34 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:34.312279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:34.312868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:34.319379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.319826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.320568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.320995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.452629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:34.461103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-973f6780-a616-4032-8bf7-5f67cba164bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.152686 Jul 20 09:38:34.461669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 190/393] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:34 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:34.464275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:34.464882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:34.470762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.471899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.472729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:34.473165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:34.604987 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:34.613251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-20206694-2e09-4eba-8d46-e29e00cc7274 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1367 microversion: 2.1 time: 0.152837 Jul 20 09:38:34.614444 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 204/394] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:34 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:35.310908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:35.311535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:35.318980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.319652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.320166 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.320588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.448965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:35.456976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:35.458467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:35.459634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-96e07a46-8098-481a-915d-fd1c7017e68c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.152657 Jul 20 09:38:35.460176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 191/395] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:35 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:35.477647 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:35.478247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:35.484666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.485101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.485835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.486255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.619282 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:35.628816 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0f981372-5e7c-4776-ac10-93d354a77d2e tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.154832 Jul 20 09:38:35.629380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 205/396] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:35 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:35.629999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:35.630594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:35.636551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.636986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.637737 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.638155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.770635 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:35.778335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-73d1b654-281a-4dc1-b424-a3d1ff34ab59 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1561 microversion: 2.1 time: 0.152313 Jul 20 09:38:35.779072 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 192/397] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:35 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:35.796484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:35.797290 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:35.803229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.803705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.804610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:35.804862 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:35.884336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bb8de928-eee4-4452-866b-9305200a2e5c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091583 Jul 20 09:38:35.884938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 206/398] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:38:35 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:36.478189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:36.478768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:36.485196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:36.485632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:36.486973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:36.487443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:36.647594 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:36.648220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:36.654125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:36.654559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:36.655418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:36.655844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:36.748085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:36.756784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:36.758575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:36.760210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-08c3ca8a-0f98-4f3a-b5f8-619055d62f54 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.285908 Jul 20 09:38:36.760955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 193/399] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:36 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:36.799955 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:36.807859 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4f591112-397d-4e63-a5ce-db0b4a772b5b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.165335 Jul 20 09:38:36.808418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 207/400] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:36 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:37.104233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-f02798f3-96f7-404e-887b-1b065376f851 req-acc2a20b-82e4-4f0f-b472-835a393afbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:37.112377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f02798f3-96f7-404e-887b-1b065376f851 req-acc2a20b-82e4-4f0f-b472-835a393afbba service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:37.112815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f02798f3-96f7-404e-887b-1b065376f851 req-acc2a20b-82e4-4f0f-b472-835a393afbba service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:37.123266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-f02798f3-96f7-404e-887b-1b065376f851 req-acc2a20b-82e4-4f0f-b472-835a393afbba service nova] Creating event network-changed:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:38:37.128819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-f02798f3-96f7-404e-887b-1b065376f851 req-acc2a20b-82e4-4f0f-b472-835a393afbba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028200 Jul 20 09:38:37.129396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 194/401] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:37.779690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:37.780292 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:37.787488 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:37.787928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:37.790079 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:37.790618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:37.826223 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:37.826963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:37.833928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:37.834414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:37.835461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:37.835891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:37.936781 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:37.946204 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:37.947967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:37.949365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c18b0b41-806c-46cf-8052-d24ee52b5bb1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.173554 Jul 20 09:38:37.950111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 208/402] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:37 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:37.996321 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:38.014000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a65953b9-a5ed-4fb4-b60c-15d4e7d9d027 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.192396 Jul 20 09:38:38.014526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 195/403] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:37 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:38.970238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:38.972262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:38.981048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:38.982148 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:38.983483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:38.984014 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:39.031931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:39.033795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:39.041271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:39.041839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:39.042615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:39.043091 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:39.133387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:39.141486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:39.143714 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:39.144864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-054fd6f8-3f01-44bd-a85c-2180abed65fb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.180107 Jul 20 09:38:39.145411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 209/404] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:38 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:39.299798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:39.314158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2add7072-541e-47d4-af80-9dd320c5f437 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.279925 Jul 20 09:38:39.314158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 196/405] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:39 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:40.163395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:40.164257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:40.170786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:40.171231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:40.172016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:40.172450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:40.309626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:40.318671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:40.319968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:40.321301 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-272a3177-bb43-436c-8097-6e60eb01628b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.162034 Jul 20 09:38:40.322020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 210/406] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:40 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:40.324864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:40.331214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:40.338262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:40.338787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:40.339655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:40.340151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:40.474939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:40.482840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e698358d-df03-4462-b3c8-6e8f637933c9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1724 microversion: 2.1 time: 0.161795 Jul 20 09:38:40.483415 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 197/407] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:40 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:41.340901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:41.341497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:41.343975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:41.350137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.350867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.351908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.352355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.492314 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:41.501254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:41.502266 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:41.502386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:41.503154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:41.504540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-aa0a9fc1-70b0-4fc7-a8f6-f87a6e6f836a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.167518 Jul 20 09:38:41.505306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 211/408] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:41 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:41.508794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.509301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.510047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.510467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.646605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:41.650055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:41.655320 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2f850291-f4a3-4ebe-b204-5501d2dc4329 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1701 microversion: 2.1 time: 0.158004 Jul 20 09:38:41.655879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 198/409] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:41 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:38:41.672473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-23abad16-dcb7-44af-876e-84e149acd436 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:41.679114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23abad16-dcb7-44af-876e-84e149acd436 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.679592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23abad16-dcb7-44af-876e-84e149acd436 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.704397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-23abad16-dcb7-44af-876e-84e149acd436 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Going to try to start instance {{(pid=124373) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 09:38:41.745844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-23abad16-dcb7-44af-876e-84e149acd436 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action" status: 202 len: 0 microversion: 2.1 time: 0.077029 Jul 20 09:38:41.746426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 212/410] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:38:41 2022] POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:38:41.754809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:41.755429 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:41.761502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.761936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.762677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:41.763100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:41.932940 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:41.941391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3921d7f7-0485-46b4-a624-d5276c4058f8 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1710 microversion: 2.1 time: 0.190585 Jul 20 09:38:41.941977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 199/411] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:41 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:42.221833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:42.222414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:42.228567 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.229004 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:42.229757 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.230209 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:42.316298 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lazy-loading 'services' on Instance uuid d051e821-9e2a-41b3-959b-5dae072de01e {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:38:42.389339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-48c11530-eff1-42d5-a669-99b5da0c6ece tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e/os-volume_attachments/df5e16cd-f481-4439-a81d-e4798ae485b3" status: 202 len: 0 microversion: 2.1 time: 0.172074 Jul 20 09:38:42.394214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 213/412] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:38:42 2022] DELETE /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e/os-volume_attachments/df5e16cd-f481-4439-a81d-e4798ae485b3 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:38:42.523592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:42.524261 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:42.530624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.531188 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:42.531967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.532391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:42.663996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:42.671748 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:42.673239 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:42.674979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3d35bde1-4a1b-4d20-bd1c-8f677b309312 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.155403 Jul 20 09:38:42.675564 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 200/413] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:42 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:42.959779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:42.960471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:42.966763 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.967211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:42.967993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:42.968425 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:43.098635 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:43.106387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ef535fef-9061-4294-853d-139cc672c471 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1710 microversion: 2.1 time: 0.150853 Jul 20 09:38:43.106937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 214/414] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:42 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:43.692991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:43.693594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:43.700120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:43.700505 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:43.701253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:43.701686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:43.834533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:43.842318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:43.843852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:43.844996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8b7a2988-d99e-4e2f-a313-095f6c7a9113 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156031 Jul 20 09:38:43.846183 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 201/415] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:43 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:44.123885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:44.124501 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:44.130653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:44.131100 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:44.131910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:44.132341 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:44.273890 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:44.282288 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c1aa08e8-fcca-41f3-aca6-464da753a322 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1714 microversion: 2.1 time: 0.162233 Jul 20 09:38:44.283639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 215/416] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:44 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:44.864545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:44.865144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:44.867446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:44.872658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:44.873125 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:44.873876 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:44.874304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:45.006951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:45.014841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:45.016376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:45.017805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4bdb6b32-5af3-45b2-95ee-f7fb57ad1065 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.157647 Jul 20 09:38:45.018563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 202/417] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:44 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:45.638235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:45.638951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:45.646723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:45.647168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:45.647953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:45.648376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:45.652538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:38:45.675985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:38:45.748312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d650cde5-db45-4833-b909-26056f413c79 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 204 len: 0 microversion: 2.1 time: 0.113631 Jul 20 09:38:45.748798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 216/418] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:38:45 2022] DELETE /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:38:45.757557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:45.758155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:45.764108 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:45.764551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:45.765292 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:45.765725 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:45.899392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:45.906873 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2599372f-cae4-4dc7-9d2f-1fbc44d9953c tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1513 microversion: 2.1 time: 0.153198 Jul 20 09:38:45.907534 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 203/419] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:45 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:46.041008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:46.041696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:46.047612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:46.048046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:46.048809 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:46.049347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:46.188192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:46.197582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:46.199112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:46.200306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4377cd42-3b05-4410-8d12-367dfe866170 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.167021 Jul 20 09:38:46.200860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 217/420] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:46 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:46.923846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:46.924476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:46.933378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:46.933916 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:46.934721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:46.935150 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:47.074750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:47.082274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7611e564-33af-42e2-bfbc-2e040d55f4a4 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1513 microversion: 2.1 time: 0.162336 Jul 20 09:38:47.082836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 204/421] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:46 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:47.219031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:47.219660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:47.226108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:47.226547 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:47.227315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:47.227747 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:47.360516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:47.369538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:47.371042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:47.372225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e6532228-6c09-4812-ad0a-2e1c4265b9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.157043 Jul 20 09:38:47.372761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 218/422] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:47 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:48.100336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:48.100935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:48.107579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:48.108017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:48.108918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:48.109342 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:48.390108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:48.391414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:48.398581 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:48.399031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:48.399835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:48.400265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:48.457199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:48.464935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0c8135f1-f4ef-4528-994d-64f787357b59 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1513 microversion: 2.1 time: 0.369202 Jul 20 09:38:48.465674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 205/423] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:48 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:48.538617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:48.546656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:48.548909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:48.550073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-811dc7eb-5b6f-42d3-8efc-4527a8f0909f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.163900 Jul 20 09:38:48.550627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 219/424] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:48 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:48.894805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-9f7a0757-86b1-4dfb-a0f4-7fe45348a268 req-1fa3e879-cee4-47ec-883a-1353c138ddfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d051e821-9e2a-41b3-959b-5dae072de01e", "name": "network-vif-deleted", "tag": "05b33b7b-829b-4473-aa2c-bbd829bd3e23"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:48.910742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-9f7a0757-86b1-4dfb-a0f4-7fe45348a268 req-1fa3e879-cee4-47ec-883a-1353c138ddfe service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:48.911198 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-9f7a0757-86b1-4dfb-a0f4-7fe45348a268 req-1fa3e879-cee4-47ec-883a-1353c138ddfe service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:48.926355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-9f7a0757-86b1-4dfb-a0f4-7fe45348a268 req-1fa3e879-cee4-47ec-883a-1353c138ddfe service nova] Creating event network-vif-deleted:05b33b7b-829b-4473-aa2c-bbd829bd3e23 for instance d051e821-9e2a-41b3-959b-5dae072de01e on hv-cinder-82282 Jul 20 09:38:48.933928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-9f7a0757-86b1-4dfb-a0f4-7fe45348a268 req-1fa3e879-cee4-47ec-883a-1353c138ddfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043300 Jul 20 09:38:48.934550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 206/425] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:49.481989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:49.482624 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:49.489140 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:49.489578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:49.490324 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:49.490843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:49.523596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:49.524033 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:49.524476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lazy-loading 'fault' on Instance uuid d051e821-9e2a-41b3-959b-5dae072de01e {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:38:49.566540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed56ed8be784927917986375a76df4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d7611d92a47fd94dd66c8ff10a7f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:49.568942 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:49.569639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:49.574073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-450835c6-d963-4a12-9635-1ad6d0672162 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 200 len: 1309 microversion: 2.1 time: 0.095976 Jul 20 09:38:49.574570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 220/426] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:49 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:38:49.576532 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:49.576986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:49.577741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:49.578178 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:49.708952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:49.717038 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:49.718552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:49.719770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d7136445-5e4e-4068-8c5e-10bbbe053ce8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156182 Jul 20 09:38:49.720844 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 207/427] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:49 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:38:50.591571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:50.592178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] [instance: d051e821-9e2a-41b3-959b-5dae072de01e] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:50.598638 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:50.599079 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:50.599867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:50.600290 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:50.615720 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] HTTP exception thrown: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Request method failure captured: Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e HTTP/1.1 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yZjtUV2O-ZiA0D5G_3IqeRsdll5hmswDm2cB7I_1JK_zYbxQ7Q6rM5wycnHHx7HJ39v7VpVpp3ofDYGlNTf4Zb1es888GxnEGBE3X-AhYsmzdUY-27LcXwjfOdqrbhzvWUWfPKdmrTQ0Qd0cGR0gTwuaDYDflX-sCxaJgtWvXCHCI Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 298d7611d92a47fd94dd66c8ff10a7f3 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:38:50.617369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/298d7611d92a47fd94dd66c8ff10a7f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/298d7611d92a47fd94dd66c8ff10a7f3"}]}] Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 298d7611d92a47fd94dd66c8ff10a7f3 Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-430022248 Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesSnapshotTestJSON-430022248-project Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 7ed56ed8be784927917986375a76df4c Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesSnapshotTestJSON-430022248-project Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. Jul 20 09:38:50.618936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'd051e821-9e2a-41b3-959b-5dae072de01e'} Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:38:50.619857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. Jul 20 09:38:50.621385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:38:50.622691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] Returning 404 to user: Instance d051e821-9e2a-41b3-959b-5dae072de01e could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:38:50.622691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e02ceb09-8d36-436a-9bd4-88fe26ecc9b9 tempest-VolumesSnapshotTestJSON-430022248 tempest-VolumesSnapshotTestJSON-430022248-project] 10.222.0.18 "GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e" status: 404 len: 111 microversion: 2.1 time: 0.031535 Jul 20 09:38:50.622691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 221/428] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:38:50 2022] GET /compute/v2.1/servers/d051e821-9e2a-41b3-959b-5dae072de01e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:38:50.738579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:50.739181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:50.745889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:50.746340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:50.747105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:50.747742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:50.915471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:50.926470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:50.928118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:50.931718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d3493cbd-5f70-4fef-bde8-29b2be383638 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1745 microversion: 2.20 time: 0.197584 Jul 20 09:38:50.936142 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 208/429] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:50 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:51.953705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:51.954316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:51.961160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:51.961604 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:51.962360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:51.962789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:52.108283 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:52.116950 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:52.118457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:52.119631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-93191049-8a8b-493a-b405-6edc4264f436 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1745 microversion: 2.20 time: 0.169745 Jul 20 09:38:52.120173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 222/430] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:51 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:52.586373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-fa672054-0356-46fb-b1c2-995b5f6c452b req-28830f2d-743c-44f8-b533-919fdd1a3da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "name": "network-vif-plugged", "status": "completed", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:38:52.595834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-fa672054-0356-46fb-b1c2-995b5f6c452b req-28830f2d-743c-44f8-b533-919fdd1a3da6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:52.596404 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-fa672054-0356-46fb-b1c2-995b5f6c452b req-28830f2d-743c-44f8-b533-919fdd1a3da6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:52.607591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-fa672054-0356-46fb-b1c2-995b5f6c452b req-28830f2d-743c-44f8-b533-919fdd1a3da6 service nova] Creating event network-vif-plugged:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:38:52.612762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-fa672054-0356-46fb-b1c2-995b5f6c452b req-28830f2d-743c-44f8-b533-919fdd1a3da6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030076 Jul 20 09:38:52.613372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 209/431] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:38:53.138188 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:53.138741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:53.145344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:53.145785 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:53.146561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:53.146988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:53.283490 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:53.292090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:53.293590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:53.294738 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-98e950dd-6359-4751-92b5-cf0bd40aca87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1745 microversion: 2.20 time: 0.160475 Jul 20 09:38:53.295280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 223/432] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:53 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:54.314856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:54.315580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:54.321820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:54.322268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:54.323045 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:54.323502 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:54.457318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:54.465256 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:54.466769 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:54.467996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d09c089a-a0f3-4c62-8877-3b7c9ed93a41 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1745 microversion: 2.20 time: 0.158383 Jul 20 09:38:54.468554 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 210/433] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:54 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:55.485313 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:55.485970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:55.492402 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:55.492845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:55.493593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:55.494021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:55.626697 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:55.634659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:55.636228 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:55.637375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5d2652d0-bc0e-4cdc-8e81-d0355318f1f8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1745 microversion: 2.20 time: 0.156021 Jul 20 09:38:55.637924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 224/434] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:55 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:56.656965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:56.658247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:56.670195 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:56.671130 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:56.673193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:56.673959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:56.842754 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:56.853073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:56.855390 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:56.857272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-717106f6-a7a8-4e1c-b650-e530a69dc0b1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.204628 Jul 20 09:38:56.858186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 211/435] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:56 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:57.877262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:57.878019 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:57.887494 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:57.888315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:57.890646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:57.891429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:58.048191 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:58.056836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:58.058372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:58.059522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-59eb06cb-c80c-4484-8c9a-7fbaad9fd5f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.186849 Jul 20 09:38:58.067267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 225/436] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:57 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:38:59.078205 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:38:59.080095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:38:59.087176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:59.087762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:59.088656 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:38:59.089094 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:38:59.273895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:59.292506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:59.294591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:38:59.296856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bf152343-ed35-4ce0-a095-1e0d936e6381 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.222443 Jul 20 09:38:59.298590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 212/437] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:38:59 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:00.316346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:00.317229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:00.324167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:00.325055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:00.326395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:00.327026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:00.511474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:00.524032 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:00.525767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:00.527102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-930ee86a-9766-4df0-93a8-7ebd8c69c3c4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.215026 Jul 20 09:39:00.530546 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 226/438] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:00 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:01.550911 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:01.551547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:01.558271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:01.558715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:01.559544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:01.560147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:01.718811 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:01.731087 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:01.732923 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:01.734083 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-151866ed-2a55-4633-95b8-1d6461e1baf0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.187991 Jul 20 09:39:01.734632 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 213/439] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:01 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:02.752827 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:02.753461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:02.763342 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:02.763794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:02.764566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:02.765003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:02.918028 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:02.928476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:02.930010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:02.931183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ffd14b2d-8498-4dff-923a-0526a9e8ed99 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.182760 Jul 20 09:39:02.931795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 227/440] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:02 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:03.953074 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:03.954688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:03.961681 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:03.964666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:03.965852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:03.966768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:04.117914 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:04.128543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:04.130139 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:04.131454 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fa24b15f-1cd2-4af9-a825-04152db1b5fa tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.185151 Jul 20 09:39:04.132084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 214/441] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:03 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:05.152174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:05.152668 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:05.171739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:05.171739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:05.171739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:05.171739 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:05.339270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:05.349850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:05.352034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:05.353231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-531c54dc-f8a2-4bcd-8463-42bbb165bcdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1740 microversion: 2.20 time: 0.205023 Jul 20 09:39:05.353737 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 228/442] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:05 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:06.377860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:06.378296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:06.384727 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:06.385160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:06.385899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:06.386322 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:06.621954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:06.632017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:06.634181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:06.635546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ac48b690-84e7-4e36-ae2b-be1fd4da12d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1722 microversion: 2.20 time: 0.262866 Jul 20 09:39:06.636097 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 215/443] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:06 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:07.655453 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:07.656059 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:07.662364 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:07.662806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:07.663836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:07.664266 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:07.814357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:07.822216 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:07.823738 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:07.824873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3e26be33-c6ab-4cbf-994c-f9a734b35796 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1722 microversion: 2.20 time: 0.173210 Jul 20 09:39:07.825423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 229/444] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:07 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:08.432215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:39:08.432746 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Wed Jul 20 09:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:39:08.843208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:08.843989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:08.851383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:08.851987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:08.853189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:08.853717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:08.989141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:08.992571 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=100 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:08.998225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:08.999747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:09.001606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-96d17f09-ce82-4779-b798-9a7f98a03cdd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1722 microversion: 2.20 time: 0.162287 Jul 20 09:39:09.002146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 216/445] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:08 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:39:10.019787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:10.020389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:10.026840 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.027305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.028057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.028486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.155424 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:10.163722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:10.165300 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:10.166442 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-119eaa06-c37b-4be4-b044-17e899b4fddb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1665 microversion: 2.20 time: 0.150539 Jul 20 09:39:10.166992 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 230/446] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:10 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:10.185132 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ae93036-7f17-453e-a79e-b81c76f9b89e"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:10.186274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:10.193950 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.194536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.195563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.196007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.471000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8c9a9d90-9be9-4066-ab97-ca21cf0fc03b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289925 Jul 20 09:39:10.471644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 217/447] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jul 20 09:39:10 2022] POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:39:10.593397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:10.594455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:10.600352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.600792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.601543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.601966 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.613862 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-1dadf5ad-e58d-4d37-8e50-9183dc62eb58 req-21b612e6-4277-4f7b-b69d-5a5b09e8a893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "name": "network-vif-unplugged", "status": "completed", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:10.620142 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:10.623573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-1dadf5ad-e58d-4d37-8e50-9183dc62eb58 req-21b612e6-4277-4f7b-b69d-5a5b09e8a893 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:10.624056 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-1dadf5ad-e58d-4d37-8e50-9183dc62eb58 req-21b612e6-4277-4f7b-b69d-5a5b09e8a893 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:10.635893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.compute.server_external_events [req-1dadf5ad-e58d-4d37-8e50-9183dc62eb58 req-21b612e6-4277-4f7b-b69d-5a5b09e8a893 service nova] Unable to find a host for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d. Dropping event network-vif-unplugged {{(pid=124374) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 09:39:10.636863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-1dadf5ad-e58d-4d37-8e50-9183dc62eb58 req-21b612e6-4277-4f7b-b69d-5a5b09e8a893 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027920 Jul 20 09:39:10.637511 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 218/448] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 09:39:10.702049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [722ff595-d26d-4ffe-8eee-b84f0d4c0e76] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 09:39:11.709352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO oslo.messaging._drivers.impl_rabbit [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [722ff595-d26d-4ffe-8eee-b84f0d4c0e76] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 54800. Jul 20 09:39:11.712390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-77e72ee8-2003-49f3-8fb7-c806d348a9d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/action" status: 202 len: 0 microversion: 2.20 time: 1.122905 Jul 20 09:39:11.713008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 231/449] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jul 20 09:39:10 2022] POST /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/action => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:39:11.721602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:11.722892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:11.729516 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:11.729959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:11.730719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:11.731176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:11.864208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:11.872772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:11.874290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:11.875705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7711467e-c95f-4a6e-9148-1a8c93249579 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1751 microversion: 2.20 time: 0.158397 Jul 20 09:39:11.876575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 219/450] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:11 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:12.894633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:12.895242 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:12.897228 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:12.903338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:12.903789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:12.904545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:12.904979 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:13.033784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:13.042420 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:13.043984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:13.045133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9337aef3-66cf-4400-a90a-afa86c2b80f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1753 microversion: 2.20 time: 0.155091 Jul 20 09:39:13.045692 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 232/451] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:12 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:14.065170 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:14.065887 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:14.072579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:14.073019 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:14.073779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:14.074209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:14.286649 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:14.295575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:14.297194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:14.298369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cb693fb6-079d-45b5-bc6c-69f461b807f9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.237992 Jul 20 09:39:14.298926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 220/452] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:14 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:15.319090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:15.319900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:15.337093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:15.337991 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:15.339454 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:15.341752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:15.541603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:15.552283 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:15.553788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:15.554961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a495b910-131b-4dd0-92c3-2de10fb37b2c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.241934 Jul 20 09:39:15.556031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 233/453] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:15 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:16.576909 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:16.578362 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:16.588094 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=38 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:16.590850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:16.591575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:16.592806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:16.593453 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:16.784426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:16.803141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:16.809095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:16.810657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2e7cf5b4-d06b-4228-aa91-a83f66d6eec7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.239537 Jul 20 09:39:16.823771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 221/454] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:16 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:17.833790 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:17.835271 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:17.850609 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:17.851957 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:17.853056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:17.853712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:18.202649 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:18.217512 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:18.219497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:18.223108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5f043b96-50c3-4acd-b5bd-58b21ac5b9bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.393416 Jul 20 09:39:18.235601 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 234/455] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:17 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:19.242297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:19.244212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:19.252976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:19.254299 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:19.264996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:19.265726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:19.572633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:19.585752 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:19.587774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:19.589101 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8e6c34ef-4079-4e54-ade5-c428455210f6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.350851 Jul 20 09:39:19.589758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 222/456] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:19 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:20.608552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:20.609066 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:20.616713 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:20.617495 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:20.618430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:20.619078 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:20.892062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:20.914797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:20.925392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:20.934850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1d86e332-ebe7-43ed-b4e5-6f8ead565871 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.323768 Jul 20 09:39:20.939964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 235/457] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:20 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:39:21.958671 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:21.959463 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:21.969729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:21.970464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:21.972401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:21.979891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:22.315847 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:22.338605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:22.348386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:22.352245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-23c524e2-d60c-4d8a-bc9f-b38f878a1777 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.397524 Jul 20 09:39:22.353741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 223/458] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:21 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:23.377005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:23.378526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:23.388703 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:23.389152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:23.389971 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:23.390349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:23.551187 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:23.569326 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:23.571303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:23.572672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b481ec8a-b40f-48e0-987f-435c05f877a2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.204488 Jul 20 09:39:23.573398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 236/459] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:23 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:24.591305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:24.591975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:24.602106 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:24.603322 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:24.604689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:24.605548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:24.929707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:24.954484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:24.958171 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:24.964584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-688b14d6-ac72-44cc-987b-368bd30a59a3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.377151 Jul 20 09:39:24.965630 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 224/460] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:24 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:25.984227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:25.984953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:25.992764 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:25.998199 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:25.999533 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:26.000670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:26.253020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:26.267021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:26.268942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:26.270369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-817f026e-18af-4d66-9b70-7948d34d96b4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.290120 Jul 20 09:39:26.271492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 237/461] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:25 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:27.289079 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:27.289766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:27.297671 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:27.298591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:27.299507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:27.300037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:27.458611 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:27.469271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:27.471345 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:27.472739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-08dd2a2f-2a7b-4677-89fd-dd8dec0ed614 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.188563 Jul 20 09:39:27.473303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 225/462] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:27 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:28.491515 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:28.492127 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:28.499769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:28.501068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:28.502041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:28.502472 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:28.661414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:28.670470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:28.672802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:28.674360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a995ff73-d05b-4eef-a6d7-7dcd998cec63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.187850 Jul 20 09:39:28.674921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 238/463] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:28 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:29.694084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:29.695401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:29.703920 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:29.704575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:29.705353 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:29.705781 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:29.907934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:29.917931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:29.919801 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:29.921058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a19a46f9-0a8c-4a97-aeca-a71a5e99eb52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.231266 Jul 20 09:39:29.922205 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 226/464] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:29 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:30.943192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:30.944548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:30.953581 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:30.955086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:30.956126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:30.956722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:31.152949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:31.164413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:31.166162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:31.167603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e5b5e858-8973-4445-a769-4b4f6cc072bf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.230850 Jul 20 09:39:31.168785 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 239/465] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:30 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:32.189445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:32.190738 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:32.202268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:32.203855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:32.205596 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:32.206422 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:32.467884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656d7cc0-698c-4ba9-ba51-989991ac49f9"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:32.469793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:32.478089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:32.485916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:32.486420 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:32.487237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:32.490357 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:32.491598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:32.492303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:32.493667 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c2c3e037-e6c7-4ad2-a22b-1f953cd2202f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.310328 Jul 20 09:39:32.505527 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 227/466] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:32 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:32.845742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-71e8f1ff-e209-45ba-b672-2db00b4259f9 req-9b5777cb-bc8e-401a-bd5c-96f0fbd65978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "name": "network-vif-plugged", "status": "completed", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:32.860721 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-71e8f1ff-e209-45ba-b672-2db00b4259f9 req-9b5777cb-bc8e-401a-bd5c-96f0fbd65978 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:32.861535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-71e8f1ff-e209-45ba-b672-2db00b4259f9 req-9b5777cb-bc8e-401a-bd5c-96f0fbd65978 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:32.876278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-71e8f1ff-e209-45ba-b672-2db00b4259f9 req-9b5777cb-bc8e-401a-bd5c-96f0fbd65978 service nova] Creating event network-vif-plugged:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:39:32.881206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6eb67f04-4d69-4a10-a6fb-eedf8c056486 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412403 Jul 20 09:39:32.884725 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 240/467] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:39:32 2022] POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:39:32.896375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-71e8f1ff-e209-45ba-b672-2db00b4259f9 req-9b5777cb-bc8e-401a-bd5c-96f0fbd65978 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054482 Jul 20 09:39:32.899855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 228/468] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:39:33.124390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:33.125704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:33.138029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:33.138984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:33.140080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:33.141803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:33.286551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lazy-loading 'services' on Instance uuid 09550419-8417-4448-af4b-10d9534548a4 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:39:33.473172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-87ad73f8-fe94-44ee-a5aa-9f3b976e956c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments/995cf474-c7ef-4213-9a51-90910b4c2cea" status: 202 len: 0 microversion: 2.1 time: 0.353809 Jul 20 09:39:33.474375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 241/469] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:39:33 2022] DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments/995cf474-c7ef-4213-9a51-90910b4c2cea => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:39:33.513881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:33.514574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:33.528389 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:33.529087 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:33.530023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:33.532243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:34.008076 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:34.020790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:34.022629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:34.023927 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6a71228c-7acb-4e81-bbeb-5159ffe28ebd tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.514782 Jul 20 09:39:34.035426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 229/470] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:33 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:35.043368 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:35.044249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:35.053293 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:35.053732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:35.054506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:35.054910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:35.213929 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:35.224959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:35.226464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:35.228909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f5271c2d-8e38-44c5-a8c5-df5d29696fcb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1809 microversion: 2.20 time: 0.190346 Jul 20 09:39:35.229961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 242/471] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:35 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:36.250636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:36.251235 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:36.257905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:36.258593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:36.259556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:36.260153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:36.415730 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:36.425344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:36.427695 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:36.429274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-60499fca-9917-494b-af61-9ab1739a8bda tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1796 microversion: 2.20 time: 0.184885 Jul 20 09:39:36.430364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 230/472] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:39:36 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1796 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:39:38.166635 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4eab4490-e7c2-4955-9325-f79ffc649f88 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'create', calling method: .version_select at 0x7f81f447e9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-601175781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQVz65c3UXDfeis3QtfLPOk6jKjaUKBlhPl8GVMGpxH1J68bWZlqDeS2aCHMZbwbGHynMcC2k7mmkoCWm3/XVM5scWuuUaHPcsZwNCHJsPNfNCmw+uPVKQehT+n6hTBZQ=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:38.181376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-4eab4490-e7c2-4955-9325-f79ffc649f88 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Getting quotas for project 65ccb95f08764f99b5a5c1166c42410b. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:39:38.185136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-4eab4490-e7c2-4955-9325-f79ffc649f88 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Getting quotas for user e4f9820744874f9c979cb18cbf624fb4 and project 65ccb95f08764f99b5a5c1166c42410b. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:39:38.207680 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4eab4490-e7c2-4955-9325-f79ffc649f88 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045155 Jul 20 09:39:38.208260 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 243/473] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:39:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:39:38.257015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-51900781", "imageRef": "3b1c8589-f02d-4144-a0a3-133eacf5425e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-601175781", "networks": [{"uuid": "7ed66025-4c0d-4641-af19-2ad6eb5abae0"}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:38.309338 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] validate_networks() for [('7ed66025-4c0d-4641-af19-2ad6eb5abae0', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:39:38.672532 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:39:38.673023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:39:38.673500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:39:38.673904 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:39:38.674313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:39:38.683184 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:38.683655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:38.684440 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:38.684872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:38.701131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Getting quotas for project 65ccb95f08764f99b5a5c1166c42410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:39:38.705605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Getting quotas for user e4f9820744874f9c979cb18cbf624fb4 and project 65ccb95f08764f99b5a5c1166c42410b. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:39:38.716186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:39:38.718963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1c8589-f02d-4144-a0a3-133eacf5425e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:39:38.763880 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-546f3781-e08a-4b3f-8c44-086cee1987bd tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510639 Jul 20 09:39:38.764521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 231/474] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:39:38.774917 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b89bb2ec-5366-4dea-b2fd-f4f279026a4d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:38.776437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b89bb2ec-5366-4dea-b2fd-f4f279026a4d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:38.830343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b89bb2ec-5366-4dea-b2fd-f4f279026a4d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:38.838031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b89bb2ec-5366-4dea-b2fd-f4f279026a4d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1256 microversion: 2.1 time: 0.066883 Jul 20 09:39:38.838781 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 244/475] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:38 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:39.856773 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:39.857378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:39.864364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:39.864805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:39.865565 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:39.866000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:39.931570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:39.935255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:39.944726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-516e1b4f-8369-4366-8750-bedd8e4dd8a0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1252 microversion: 2.1 time: 0.093440 Jul 20 09:39:39.945297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 232/476] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:39 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:40.496940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:40.497864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:40.504690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.505129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:40.505919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.506343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:40.534826 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lazy-loading 'flavor' on Instance uuid b2276d91-021a-48eb-b539-ac70600ccf61 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:39:40.639822 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:40.671630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-def85b4a-286e-489e-82d7-61edb2f170a6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/action" status: 200 len: 32 microversion: 2.1 time: 0.179125 Jul 20 09:39:40.676327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 245/477] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:39:40 2022] POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 09:39:40.683082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:40.683723 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:40.695266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.695266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:40.696072 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.697270 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:40.963779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:40.965068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:40.974776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.975618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:40.976654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:40.977384 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:41.067021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:41.080537 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c1426427-e0ce-4d15-8063-4ce8c77d2066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.402841 Jul 20 09:39:41.083683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 233/478] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:40 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:41.086390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:41.104771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-42cbfc1c-3f55-432c-b6e4-a5bae064a4b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:41.106011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a9cca482-50e1-4306-8caa-32ee5e245bad tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1314 microversion: 2.1 time: 0.147297 Jul 20 09:39:41.108662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 246/479] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:40 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:41.113541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-42cbfc1c-3f55-432c-b6e4-a5bae064a4b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:41.113981 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-42cbfc1c-3f55-432c-b6e4-a5bae064a4b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:41.202242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-42cbfc1c-3f55-432c-b6e4-a5bae064a4b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Going to try to stop instance {{(pid=124374) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 09:39:41.266544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-42cbfc1c-3f55-432c-b6e4-a5bae064a4b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action" status: 202 len: 0 microversion: 2.1 time: 0.166998 Jul 20 09:39:41.267328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 234/480] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:39:41 2022] POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:39:41.276766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:41.277723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:41.286899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:41.293347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:41.293347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:41.293347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:41.549973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:41.559714 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-41121af9-9bed-4669-a765-a293b460b8cb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.286770 Jul 20 09:39:41.560417 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 247/481] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:41 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:42.103864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:42.104583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:42.112423 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.112865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.113713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.114049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.127643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:42.128819 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:42.135699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.136443 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.137435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.138095 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.273132 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:42.284058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-92b02499-0b79-48eb-933f-103f72eea588 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.184411 Jul 20 09:39:42.284652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 235/482] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:42 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:42.321524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:42.329161 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d9fa52bd-62f0-401a-a11a-96ccf4283616 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.205944 Jul 20 09:39:42.330105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 248/483] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:42 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:42.577511 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:42.578114 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:42.584214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.584652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.585403 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:42.585828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:42.730115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:42.738710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-beea29f9-dad4-4c66-9889-bb629d48edb1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.165103 Jul 20 09:39:42.739648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 236/484] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:42 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:43.301844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:43.302446 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:43.305059 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:43.310710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.311161 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.312823 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.313548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.346161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:43.346758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:43.353385 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.354141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.355265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.355934 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.474853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:43.485493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1ab34b2d-1080-4f6d-961f-d65374ab622f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.187262 Jul 20 09:39:43.486483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 249/485] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:43 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:43.532742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:43.540756 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c22a6975-40be-4031-897c-965bfdcbdcbf tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.198528 Jul 20 09:39:43.541341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 237/486] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:43 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:43.757099 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:43.757795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:43.764623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.765134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.765897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:43.766327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:43.916176 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:43.925899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-be07e130-02c2-4e87-a82f-15d0e281a227 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.173006 Jul 20 09:39:43.926733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 250/487] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:43 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:44.504095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:44.505046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:44.511849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.512294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:44.513056 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.513482 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:44.557878 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:44.558591 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:44.566878 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.567517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:44.568417 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.568956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:44.693894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:44.702120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d4a6e1b7-ee8b-4a3c-81d0-92c9692879c3 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.202163 Jul 20 09:39:44.704009 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 238/488] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:44 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:44.739135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:44.746982 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-563f92b8-4296-44f3-996b-a22c71b12c4a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.192946 Jul 20 09:39:44.747909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 251/489] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:44 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:44.942405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:44.943269 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:44.949637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.950012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:44.950767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:44.951195 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:45.114169 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:45.121863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ac20355c-aa62-49fc-a303-d0f5352c3363 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.183207 Jul 20 09:39:45.122459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 239/490] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:44 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:45.722475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:45.724170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:45.731596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:45.732159 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:45.732995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:45.734139 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:45.765636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:45.766247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:45.778202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:45.778702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:45.779789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:45.780233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:45.883411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:45.892384 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-35a0aba9-1ca3-4869-8d80-9d6625cf4036 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.174862 Jul 20 09:39:45.893277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 252/491] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:45 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:45.930525 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:45.938497 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-dabfd345-9db4-4a1a-81a9-af5e0aac2a5b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.176915 Jul 20 09:39:45.939276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 240/492] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:45 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:46.140654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:46.141262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:46.147787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.148244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:46.149195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.149636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:46.290492 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:46.298386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b03b23a4-05e4-4a58-a888-91f8f49e86e4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.162323 Jul 20 09:39:46.298956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 253/493] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:46 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:46.910247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:46.910845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:46.917030 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:46.918907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.919370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:46.920269 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.920706 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:46.954832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:46.955539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:46.962243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.962699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:46.963512 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:46.963947 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:47.085278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:47.094571 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7f2616b4-69fe-4ea5-bdc8-d4849d611f28 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.188082 Jul 20 09:39:47.095149 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 241/494] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:46 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:47.144312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:47.152090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-23c29f59-1a83-4261-8ec5-af85aca49986 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.201098 Jul 20 09:39:47.152702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 254/495] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:46 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:47.316025 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:47.316636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:47.322645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:47.323086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:47.323871 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:47.324301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:47.463451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:47.472193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7dd78de9-d194-4bb8-9dd2-a8b905b7ba58 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.160335 Jul 20 09:39:47.473412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 242/496] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:47 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:48.112471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:48.113250 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:48.119963 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.120416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.121188 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.121638 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.170560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:48.172051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:48.187608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.188051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.188815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.189238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.286500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:48.296895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a8aede03-15f8-4422-afea-c481cfe5773f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.188963 Jul 20 09:39:48.297548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 255/497] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:48 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:48.353965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:48.361326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-46a98597-0f0e-412e-b5e1-8e211ad19107 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.195374 Jul 20 09:39:48.361877 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 243/498] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:48 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:48.488947 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:48.489666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:48.496371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.496806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.497557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:48.497984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:48.645266 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:48.652788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-57c180d3-bc89-48d0-a2cf-b44848a8a314 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.167787 Jul 20 09:39:48.653349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 256/499] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:48 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:49.314535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:49.315141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:49.317028 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:49.317684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:49.324544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.324985 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.325751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.326182 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.378626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:49.379213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:49.381126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:49.387005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.387484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.388241 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.388675 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.521794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:49.529203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f27efc76-acf1-4d99-9622-7c45ea82337a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.155208 Jul 20 09:39:49.529961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 257/500] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:49 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:49.665107 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:49.673767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:49.674370 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:49.680576 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.681149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.682064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:49.682187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bd5ccf73-ffbe-4e3e-818d-9b45ec0df951 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.371906 Jul 20 09:39:49.682666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 244/501] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:49 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:49.682823 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:49.823787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:49.832350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-89b5b721-7782-4904-af12-0f02705f465d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.162647 Jul 20 09:39:49.835328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 258/502] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:49 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:50.075875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-e9cf908f-4c44-4534-a7d5-f2103ec42be8 req-a1e1339a-ea58-4d8d-a694-d126cd8bec3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:50.088241 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-e9cf908f-4c44-4534-a7d5-f2103ec42be8 req-a1e1339a-ea58-4d8d-a694-d126cd8bec3d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.091825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-e9cf908f-4c44-4534-a7d5-f2103ec42be8 req-a1e1339a-ea58-4d8d-a694-d126cd8bec3d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.110506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-e9cf908f-4c44-4534-a7d5-f2103ec42be8 req-a1e1339a-ea58-4d8d-a694-d126cd8bec3d service nova] Creating event network-changed:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:39:50.116469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-e9cf908f-4c44-4534-a7d5-f2103ec42be8 req-a1e1339a-ea58-4d8d-a694-d126cd8bec3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046122 Jul 20 09:39:50.117398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 245/503] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:39:50.546543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:50.547154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:50.553564 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.554008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.554758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.555200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.687779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:50.695168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5945b571-5c92-4004-bd32-06164e3de5b8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.153107 Jul 20 09:39:50.695929 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 259/504] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:50 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:50.700764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:50.701445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:50.708244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.708687 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.709438 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.709869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.845992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:50.849632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:50.850347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:50.854780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a42e0ebe-f812-49ce-9e00-ef92df35040a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.158428 Jul 20 09:39:50.855367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 246/505] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:50 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:50.856698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.857262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.858168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:50.858589 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:50.987945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:50.995272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-aa3a1d03-dbad-402d-a9f7-f7e753e8a910 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.149897 Jul 20 09:39:50.995858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 260/506] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:50 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:51.712818 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:51.713359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:51.720077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:51.720590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:51.721561 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:51.721990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:51.872849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:51.873411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:51.880480 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:51.880928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:51.881685 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:51.882113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:52.021963 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:52.025493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:52.031699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1392ec7a-a637-4a87-aa61-4b330ebe1ba6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.162735 Jul 20 09:39:52.032272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 261/507] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:51 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:52.042560 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:52.042560 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:52.045294 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:52.045916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:52.046868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:52.047318 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:52.187798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:52.195959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8d2ad6a8-0cec-4099-9f50-cbf389c4b797 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.162669 Jul 20 09:39:52.196632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 262/508] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:52 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:52.303809 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:52.311089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0f14afa1-0bb0-463d-a798-cafcd3c719b0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.602232 Jul 20 09:39:52.312281 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 247/509] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:51 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:53.050328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:53.051010 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:53.058179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.058625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.059615 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.060086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.199307 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:53.207414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bbc43a92-e751-4b7c-92d2-8a3ef0c49832 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.161537 Jul 20 09:39:53.207977 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 263/510] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:53 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:53.213655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:53.214253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:53.221447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.221892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.222641 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.223069 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.329180 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:53.330247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:53.335776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.336248 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.337395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:53.337395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:53.360180 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:53.368423 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ac138258-6cb3-4e5f-b529-49dfabbe6a1f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.158480 Jul 20 09:39:53.369080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 248/511] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:53 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:53.470100 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:53.477653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9d72a4a4-f789-4caf-a6e4-c54050788e66 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.152822 Jul 20 09:39:53.478206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 264/512] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:53 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:54.224477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:54.225073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:54.231567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.232012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.232755 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.233678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.237713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:39:54.363710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:54.371670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7e6796ab-5b28-484b-8798-6800d9ab3c32 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.150995 Jul 20 09:39:54.372238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 249/513] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:54 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:54.385617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:54.386226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:54.392691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.393140 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.393892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.394324 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.493937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:54.494538 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:54.500707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.501152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.501908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.502338 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.526522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:54.534721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d00830b6-14d5-4430-b46c-2955c3b7257d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.152834 Jul 20 09:39:54.535521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 265/514] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:54 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:54.628450 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:54.635723 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e3e9d538-09b5-487d-8ded-c4d93a2eae71 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.145692 Jul 20 09:39:54.636282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 250/515] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:54 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:54.932522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-b59af524-445f-405f-9f88-cfe995652be0 req-7e2ef446-b07d-439a-82c6-7b78623cb6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "name": "network-vif-plugged", "status": "completed", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:54.940710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-b59af524-445f-405f-9f88-cfe995652be0 req-7e2ef446-b07d-439a-82c6-7b78623cb6bd service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:54.941150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-b59af524-445f-405f-9f88-cfe995652be0 req-7e2ef446-b07d-439a-82c6-7b78623cb6bd service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:54.952942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-b59af524-445f-405f-9f88-cfe995652be0 req-7e2ef446-b07d-439a-82c6-7b78623cb6bd service nova] Creating event network-vif-plugged:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:39:54.957731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-b59af524-445f-405f-9f88-cfe995652be0 req-7e2ef446-b07d-439a-82c6-7b78623cb6bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028941 Jul 20 09:39:54.958312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 266/516] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:39:55.389214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:55.390377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:55.396797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.397252 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.397987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.398397 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.525560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:55.534062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-13330a49-5885-4dcc-af06-19d71f2c1615 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.148855 Jul 20 09:39:55.534836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 251/517] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:55 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:55.553357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:55.554057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:55.560198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.560642 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.561921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.562351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.652112 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:55.652707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:55.659244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.659705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.660444 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:55.660864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:55.695561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:55.703679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-293cdbea-9864-454c-8430-bbb9874fd59b tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.154804 Jul 20 09:39:55.704250 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 267/518] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:55 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:55.790577 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:55.798401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2ee74f49-3b99-4b9b-bd86-b79901223435 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1356 microversion: 2.1 time: 0.150082 Jul 20 09:39:55.798961 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 252/519] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:55 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:56.551312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:56.551841 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:56.558499 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.559063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.559712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.560135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.688676 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:56.698201 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b41cb933-e430-4157-a00a-d8fdb96c96e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.150771 Jul 20 09:39:56.698770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 268/520] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:56 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:56.720526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:56.721133 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:56.727539 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.727988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.728752 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.729183 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.815691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:56.816301 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:56.822288 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.822727 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.823514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.823940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.858081 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:56.865754 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9b7053fd-7d95-496e-8c65-c1aebdd87384 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.149621 Jul 20 09:39:56.866324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 253/521] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:56 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:56.956359 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:56.963702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-84d6e439-bee7-4f85-9829-e3202e1a5df5 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1546 microversion: 2.1 time: 0.152910 Jul 20 09:39:56.964252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 269/522] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:56 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:56.979932 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:56.980768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:56.987134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.987602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:56.988362 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:56.988793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.117851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:57.125238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-387175b7-f648-4776-8b0f-ee004dc46814 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1546 microversion: 2.1 time: 0.149120 Jul 20 09:39:57.125795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 254/523] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:56 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:57.141280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:57.144791 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:57.145538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Searching by: {'deleted': False, 'project_id': '65ccb95f08764f99b5a5c1166c42410b'} {{(pid=124373) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 09:39:57.152162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.152599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.153371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.153790 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.244068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.multi_cell_list [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124373) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 09:39:57.339967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2543df3a-43d1-4690-9158-cf18c2384401 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.202396 Jul 20 09:39:57.340459 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 270/524] 10.222.0.18 () {58 vars in 1124 bytes} [Wed Jul 20 09:39:57 2022] GET /compute/v2.1/servers => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:39:57.350682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:57.351282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:57.357208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.357648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.359095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.359555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.489919 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:57.497205 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1cffeca1-4234-4c11-a980-a33bdb3c07d0 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1546 microversion: 2.1 time: 0.150297 Jul 20 09:39:57.497764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 255/525] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:57 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:57.716085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:57.716694 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:57.723877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.724321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.725114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.725545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.872150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:57.880509 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fbe5203d-c5ea-4c4f-9850-d91ad2de5898 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.168226 Jul 20 09:39:57.881066 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 271/526] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:57 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:57.882918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:57.883567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:57.890542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.890982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:57.891753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:57.892260 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:58.020425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:58.027793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2445391a-5d9f-4eb9-9ce2-916b0b832fc9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.148806 Jul 20 09:39:58.028359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 256/527] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:57 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:39:58.897724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:58.898327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:58.904853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:58.905360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:58.906115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:58.906539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:59.020642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6ade61-9170-4e49-8557-66cb974ffddf"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:39:59.021795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:59.028297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:59.028735 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:59.029484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:59.030446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:59.046210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:59.054127 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-872aaa02-0c4c-4c6e-bb9b-ca8f45c87253 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.160131 Jul 20 09:39:59.054687 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 272/528] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:58 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:59.059551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:39:59.060356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:39:59.066775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:59.067382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:59.068136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:39:59.068710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:39:59.198932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:39:59.206511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-84d82692-5c5a-445c-b07f-b1074d188043 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1678 microversion: 2.1 time: 0.150884 Jul 20 09:39:59.207065 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 273/529] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:39:59 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:39:59.378587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c7002578-0cf7-487e-ae25-5bffb62ccb7b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362104 Jul 20 09:39:59.379199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 257/530] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:39:59 2022] POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:40:00.071320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:00.071850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:00.078924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.079398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.080137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.080561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.207087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:00.215016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-93374b5c-16e2-4965-9b23-4eb4314a367d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.147603 Jul 20 09:40:00.215600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 274/531] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:00 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:00.223787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:00.224471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:00.231006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.231486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.232255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.233173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.365398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:00.372764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7004e18a-28a4-4c41-9ce1-ae681b8bc545 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1655 microversion: 2.1 time: 0.153360 Jul 20 09:40:00.373977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 258/532] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:00 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:00.389598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d1df3006-7b7d-4242-aa1c-786411659459 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:00.395616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d1df3006-7b7d-4242-aa1c-786411659459 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.396058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d1df3006-7b7d-4242-aa1c-786411659459 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.417605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d1df3006-7b7d-4242-aa1c-786411659459 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Going to try to start instance {{(pid=124373) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 09:40:00.461460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d1df3006-7b7d-4242-aa1c-786411659459 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action" status: 202 len: 0 microversion: 2.1 time: 0.075538 Jul 20 09:40:00.462225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 275/533] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:40:00 2022] POST /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:40:00.471599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:00.472733 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:00.479212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.479858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.480740 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:00.481333 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:00.644061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:00.651627 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3f7243b8-1b62-4ca9-94dd-28fe7fda1a8f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1664 microversion: 2.1 time: 0.185070 Jul 20 09:40:00.652280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 259/534] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:00 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1664 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:01.233043 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:01.233787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:01.239992 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:01.240433 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:01.241183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:01.241612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:01.371961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:01.380287 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9bc08f3e-73a2-4f59-be4d-17f947c49d35 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.152278 Jul 20 09:40:01.380846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 276/535] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:01 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:01.669605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:01.670741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:01.677261 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:01.677836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:01.678639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:01.679062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:01.812958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:01.820298 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fe7fa218-80a8-41ca-b679-e42dd33f2c66 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1664 microversion: 2.1 time: 0.154644 Jul 20 09:40:01.820865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 260/536] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:01 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:02.397943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:02.398548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:02.405618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:02.406066 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:02.406820 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:02.407253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:02.533946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:02.537733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:02.542974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-db9fc3cf-e17b-4d98-b615-a66c0f0153dd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.148903 Jul 20 09:40:02.543580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 277/537] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:02 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:02.836536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:02.837115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:02.843677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:02.844117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:02.844852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:02.845274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:02.972899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:02.980129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-287a1a53-0f1e-4a53-8cf3-f028783aeee7 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1668 microversion: 2.1 time: 0.147436 Jul 20 09:40:02.980680 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 261/538] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:02 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:03.560356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:03.561095 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:03.568565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:03.569012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:03.569766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:03.570198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:03.701540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:03.709447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-61ff4668-f26d-420b-a7ff-bc6ab3fb8b9e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.153497 Jul 20 09:40:03.710007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 278/539] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:03 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:04.725771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:04.726365 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:04.733120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:04.733434 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:04.734173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:04.734603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:04.862503 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:04.870346 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a9394b24-4c86-426a-8e71-b9efbecbd46e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.148356 Jul 20 09:40:04.870901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 262/540] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:04 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:05.887342 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:05.887947 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:05.896690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:05.897141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:05.897901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:05.898331 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:06.033967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:06.042605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f2dba56e-b380-4da4-9133-967ec00dd930 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.159016 Jul 20 09:40:06.043219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 279/541] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:05 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:06.927553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:06.928152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:06.934613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:06.935051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:06.936388 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:06.936905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:07.060507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:07.061257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:07.066301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:07.067865 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:07.068897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:07.069067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:07.069684 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:07.074710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d36c6307-5f22-418d-84a3-f44657ecfade tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1592 microversion: 2.1 time: 0.151002 Jul 20 09:40:07.075280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 263/542] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:06 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1592 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:07.185179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:07.204083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:07.212093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ae1b8c5a-0b9c-41f3-b480-27a749c56612 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.155441 Jul 20 09:40:07.212653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 280/543] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:07 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:08.229780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:08.230409 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:08.237541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:08.237981 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:08.238737 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:08.239811 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:08.259929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:08.493518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:08.501584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-af7aefd6-a877-4a4a-8685-bf894dea3147 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.276046 Jul 20 09:40:08.502156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 264/544] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:08 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:08.806458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-253d9848-cfca-4ffc-99d3-120ea1b8d5aa req-4f630eaf-1be4-4f53-88ed-deeefadb2500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:08.815681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-253d9848-cfca-4ffc-99d3-120ea1b8d5aa req-4f630eaf-1be4-4f53-88ed-deeefadb2500 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:08.816214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-253d9848-cfca-4ffc-99d3-120ea1b8d5aa req-4f630eaf-1be4-4f53-88ed-deeefadb2500 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:08.829220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-253d9848-cfca-4ffc-99d3-120ea1b8d5aa req-4f630eaf-1be4-4f53-88ed-deeefadb2500 service nova] Creating event network-changed:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:40:08.834485 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-253d9848-cfca-4ffc-99d3-120ea1b8d5aa req-4f630eaf-1be4-4f53-88ed-deeefadb2500 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031639 Jul 20 09:40:08.835178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 281/545] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:09.519373 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:09.520064 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:09.527109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.528070 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.529070 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.529798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.727992 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:09.728778 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:09.731610 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:09.738369 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.739445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.740444 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.741113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.741600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eb170461-ca4c-4da1-8140-9b0d3ca18878 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.226520 Jul 20 09:40:09.753510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 265/546] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:09 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:09.788297 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-496968b7-a92d-4595-9d09-fa9f77ad2b5b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments/3ae93036-7f17-453e-a79e-b81c76f9b89e" status: 200 len: 194 microversion: 2.20 time: 0.065414 Jul 20 09:40:09.788825 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 282/547] 10.222.0.18 () {60 vars in 1453 bytes} [Wed Jul 20 09:40:09 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments/3ae93036-7f17-453e-a79e-b81c76f9b89e => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:40:09.862016 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:09.862503 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:09.868751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.869432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.870364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.870961 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.926763 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-504050771"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:09.927882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:09.934412 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.934860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:09.936222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:09.936633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.009648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lazy-loading 'services' on Instance uuid 449aaf77-3ec6-4163-bc11-ce226c2ca23d {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:40:10.080715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.network.security_group_api [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Adding security group d5604d77-a207-4fb6-9670-407112042b50 to port 2c6b639d-4460-4929-a29a-c38cbf380511 Jul 20 09:40:10.136195 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-145b4f33-ae2a-4f35-a7f7-9ccdfc65c323 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments/3ae93036-7f17-453e-a79e-b81c76f9b89e" status: 202 len: 0 microversion: 2.20 time: 0.278127 Jul 20 09:40:10.136780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 266/548] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jul 20 09:40:09 2022] DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments/3ae93036-7f17-453e-a79e-b81c76f9b89e => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:40:10.146330 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:10.147566 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:10.155161 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.156104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.157212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.157712 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.191573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b2331224-425f-4e3a-b8e4-1f02567f6c28 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049251 Jul 20 09:40:10.192312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 267/549] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jul 20 09:40:10 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:40:10.489138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-089a2ca1-6c91-430b-9b04-7c46102e649f tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action" status: 202 len: 0 microversion: 2.1 time: 0.566195 Jul 20 09:40:10.494653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 283/550] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:40:09 2022] POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:40:10.499272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-f378fc06-032a-4514-a9b1-1df06675e65c req-24e7bec8-14fd-43dc-8a61-35986e5dce3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:10.502647 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:10.503607 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:10.510185 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f378fc06-032a-4514-a9b1-1df06675e65c req-24e7bec8-14fd-43dc-8a61-35986e5dce3c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.510860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-f378fc06-032a-4514-a9b1-1df06675e65c req-24e7bec8-14fd-43dc-8a61-35986e5dce3c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.513311 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.515337 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.516280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.517338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.527659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-f378fc06-032a-4514-a9b1-1df06675e65c req-24e7bec8-14fd-43dc-8a61-35986e5dce3c service nova] Creating event network-changed:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:40:10.533845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-f378fc06-032a-4514-a9b1-1df06675e65c req-24e7bec8-14fd-43dc-8a61-35986e5dce3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039145 Jul 20 09:40:10.535019 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 268/551] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:40:10.713648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:10.725298 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e3ea9f84-f21e-4798-91b9-c2ea3a897451 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1756 microversion: 2.1 time: 0.228247 Jul 20 09:40:10.732088 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 284/552] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:10 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:10.761085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:10.761708 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:10.770504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.770948 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:10.771773 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:10.772230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.204552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:11.205838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:11.217159 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.218113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.219846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.220850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.253656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-55206033-92ce-4651-880f-e510a7aa8a1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054060 Jul 20 09:40:11.254219 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 285/553] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jul 20 09:40:11 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:11.288099 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:11.297029 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0b56b5fc-44b4-44bf-a353-72ffc6dba9ed tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.540251 Jul 20 09:40:11.311567 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 269/554] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:10 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:11.322436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:11.322923 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:11.330179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.330616 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.331385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.331807 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.356008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:40:11.447551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3bb41308-2003-4589-ae72-a858f86db780 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 204 len: 0 microversion: 2.20 time: 0.128695 Jul 20 09:40:11.448154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 286/555] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jul 20 09:40:11 2022] DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:40:11.456305 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:11.457132 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:11.463269 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.463840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.464807 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:11.465225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:11.613064 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:11.620905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:11.622414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:11.624158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-04129ca5-59c9-4b87-bd0d-319b8e5011c6 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.171690 Jul 20 09:40:11.624700 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 270/556] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:11 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:40:12.314994 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:12.315713 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:12.322353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:12.322868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:12.323681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:12.324110 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:12.455217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:12.463016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7c1e6b8e-3bb9-441a-bb70-7b521876500b tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.152505 Jul 20 09:40:12.463596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 287/557] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:12 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:12.642682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:12.643199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:12.649699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:12.650135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:12.650873 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:12.651299 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:12.783625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:12.791769 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:12.793289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:12.794414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4b81d8d9-b57f-480d-b711-047c5e887ff5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1724 microversion: 2.20 time: 0.156344 Jul 20 09:40:12.794961 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 271/558] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:12 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:13.480227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:13.480838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:13.483578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:13.490019 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:13.490464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:13.491244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:13.491702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:13.645092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:13.654729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f2b105c1-78e2-463b-8cda-b562f343debd tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.178190 Jul 20 09:40:13.655589 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 288/559] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:13 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:13.822301 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:13.824582 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:13.833059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:13.833885 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:13.835027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:13.835544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:13.949004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:13.963402 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:13.965384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:13.967603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7b3cdf9b-fdac-4f73-9a73-16a1815a9b9d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 200 len: 1656 microversion: 2.20 time: 0.157077 Jul 20 09:40:13.969283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 272/560] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:13 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:14.184780 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-3ea19c97-e4e7-445b-bd0e-e7dd640a9aaa req-faa2ab51-6dbb-4a7e-bd29-a73ea69afb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449aaf77-3ec6-4163-bc11-ce226c2ca23d", "name": "network-vif-deleted", "tag": "45838986-91b0-43b0-82e9-e712321d1783"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:14.197627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-3ea19c97-e4e7-445b-bd0e-e7dd640a9aaa req-faa2ab51-6dbb-4a7e-bd29-a73ea69afb35 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:14.199494 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-3ea19c97-e4e7-445b-bd0e-e7dd640a9aaa req-faa2ab51-6dbb-4a7e-bd29-a73ea69afb35 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:14.216012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-3ea19c97-e4e7-445b-bd0e-e7dd640a9aaa req-faa2ab51-6dbb-4a7e-bd29-a73ea69afb35 service nova] Creating event network-vif-deleted:45838986-91b0-43b0-82e9-e712321d1783 for instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d on hv-cinder-82282 Jul 20 09:40:14.221300 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-3ea19c97-e4e7-445b-bd0e-e7dd640a9aaa req-faa2ab51-6dbb-4a7e-bd29-a73ea69afb35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040034 Jul 20 09:40:14.222210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 289/561] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:40:14.673880 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:14.674838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:14.682962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:14.683918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:14.684938 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:14.687128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:14.842585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:14.850969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2816a68b-695e-44da-8034-94b3ed1cc79f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.182403 Jul 20 09:40:14.851905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 273/562] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:14 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:14.989146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:14.990730 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:15.002072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:15.002537 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:15.003866 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:15.003866 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:15.018222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d HTTP/1.1 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:40:15.019926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:40:15.021699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '449aaf77-3ec6-4163-bc11-ce226c2ca23d'} Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:40:15.022690 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:40:15.024437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:15.027135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:40:15.027135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-dcb2221b-1acf-4a83-9939-df26677a8b52 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 404 len: 111 microversion: 2.20 time: 0.036974 Jul 20 09:40:15.031431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9d7e9faf-3b3c-4d1b-8fc4-6ca2bf1f69e5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '.version_select at 0x7f81f44f6670>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:15.036830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 290/563] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:14 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 09:40:15.054772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9d7e9faf-3b3c-4d1b-8fc4-6ca2bf1f69e5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287157503" status: 204 len: 0 microversion: 2.20 time: 0.028104 Jul 20 09:40:15.055385 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 274/564] 10.222.0.18 () {60 vars in 1261 bytes} [Wed Jul 20 09:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1287157503 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:40:15.772703 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62316175-9379-44e3-a38a-cc5173ef295a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: .version_select at 0x7f81f443a550>, body: {"keypair": {"name": "tempest-keypair-763394623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbXAEin2a466+0EsbFTdpHUo4SLoHHDZPdOlxbvlwOX5KO2s+ZHj48K1etAmoxCE81pDJ40Ne6LjUHNcOCZL8ovxIa6o7T8LxjcYr1eT6O4cz6VjlJEmoJLzUr499MM7A=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:15.787569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-62316175-9379-44e3-a38a-cc5173ef295a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for project 07eb1473648d490b90a1e7debc45d57d. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:40:15.791362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-62316175-9379-44e3-a38a-cc5173ef295a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for user a37198e6d4424a51800655d3bd0a3ee6 and project 07eb1473648d490b90a1e7debc45d57d. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:40:15.812812 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-62316175-9379-44e3-a38a-cc5173ef295a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044164 Jul 20 09:40:15.813401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 291/565] 10.222.0.18 () {62 vars in 1199 bytes} [Wed Jul 20 09:40:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 09:40:15.869147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:15.869784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:15.877603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:15.878043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:15.878805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:15.879233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:16.057367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:16.066102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-144d6265-46c5-43e9-938f-42f2843e40d9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.200881 Jul 20 09:40:16.066678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 275/566] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:15 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:17.083044 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:17.083678 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:17.090001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:17.090440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:17.091192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:17.091649 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:17.128440 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110898611", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bc1f444-18bf-42e0-ae56-3a62ba59289b"}], "security_groups": [{"name": "tempest-securitygroup--618074585"}], "key_name": "tempest-keypair-763394623", "user_data": "}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:17.135517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:17.229758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:17.236433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] validate_networks() for [('3bc1f444-18bf-42e0-ae56-3a62ba59289b', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:40:17.238810 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-498f07fa-578d-4f15-a6bd-ac6d4c807879 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.159528 Jul 20 09:40:17.239487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 292/567] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:17 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:17.606233 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:40:17.606659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:40:17.607132 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:40:17.607590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:40:17.607994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:40:17.616573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:17.617023 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:17.617838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:17.618268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:17.634388 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for project 07eb1473648d490b90a1e7debc45d57d. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:40:17.638273 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Getting quotas for user a37198e6d4424a51800655d3bd0a3ee6 and project 07eb1473648d490b90a1e7debc45d57d. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:40:17.649500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:40:17.651790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:40:17.698862 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cf16517b-6e66-4afb-b6ca-5255d64b88d1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.576538 Jul 20 09:40:17.699642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 276/568] 10.222.0.18 () {62 vars in 1187 bytes} [Wed Jul 20 09:40:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 09:40:17.710096 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:17.710699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:17.763751 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:17.771675 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:17.773165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:17.774249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e5f6bb61-445e-40ed-bd83-9361cb9f4194 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1280 microversion: 2.20 time: 0.068069 Jul 20 09:40:17.774803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 293/569] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:17 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:18.256711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:18.257311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:18.264122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:18.264560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:18.265307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:18.265731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:18.392356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:18.400467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c1f99886-dbf0-4342-87f8-855ed0020a72 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.148030 Jul 20 09:40:18.401020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 277/570] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:18 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:18.791191 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:18.791854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:18.799414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:18.799858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:18.800603 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:18.801146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:18.861029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:18.868854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:18.870360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:18.871509 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c66325d8-983f-4714-b50e-b752c02ca481 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1338 microversion: 2.20 time: 0.084469 Jul 20 09:40:18.872068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 294/571] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:18 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1338 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:19.418040 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:19.419379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:19.428151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:19.428710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:19.429559 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:19.430055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:19.683391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:19.692033 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-30a92627-6009-4f72-b983-9b665dd24738 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.278191 Jul 20 09:40:19.692601 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 278/572] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:19 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:19.889847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:19.890482 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:19.896677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:19.897120 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:19.897881 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:19.898306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:20.038193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:20.047021 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:20.048569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:20.049686 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f3544821-faf9-4113-af26-2cd236707683 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.163998 Jul 20 09:40:20.050760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 295/573] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:19 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:20.362464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-41604de5-99d6-47df-861a-42eb5b4148a9 req-8bd10eea-3212-4128-8f5b-c81413eb73c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:20.370699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-41604de5-99d6-47df-861a-42eb5b4148a9 req-8bd10eea-3212-4128-8f5b-c81413eb73c5 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:20.371134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-41604de5-99d6-47df-861a-42eb5b4148a9 req-8bd10eea-3212-4128-8f5b-c81413eb73c5 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:20.381999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-41604de5-99d6-47df-861a-42eb5b4148a9 req-8bd10eea-3212-4128-8f5b-c81413eb73c5 service nova] Creating event network-changed:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:40:20.387059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-41604de5-99d6-47df-861a-42eb5b4148a9 req-8bd10eea-3212-4128-8f5b-c81413eb73c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028535 Jul 20 09:40:20.387912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 279/574] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:20.708803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:20.709328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:20.715197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:20.715662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:20.716400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:20.716826 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:20.845048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:20.853149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f276ab48-2871-4264-b5a5-20a730b6d581 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.148179 Jul 20 09:40:20.853706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 296/575] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:20 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:21.068872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:21.069556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:21.075766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:21.076861 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:21.077684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:21.078111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:21.332851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:21.340701 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:21.342248 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:21.343374 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-058f1f9a-f7a9-4b63-bc15-3930794d1742 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.279197 Jul 20 09:40:21.343929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 280/576] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:21 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:21.870615 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:21.871158 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:21.877663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:21.878108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:21.878855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:21.879300 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:21.883206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:22.016708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:22.024595 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bd4f7061-a172-45e0-995b-02693c6b6c6d tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.157978 Jul 20 09:40:22.025152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 297/577] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:21 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:22.361413 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:22.362010 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:22.368406 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:22.368838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:22.369570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:22.369989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:22.500262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:22.507990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:22.509472 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:22.510546 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d50826d5-a7f3-4e54-9529-835ef2e29782 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.153313 Jul 20 09:40:22.511101 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 281/578] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:22 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:23.042545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:23.043206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:23.050415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:23.050864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:23.051654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:23.052090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:23.181623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:23.192848 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5c0eb630-dcf0-4f5f-811b-8b66dc97c066 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1732 microversion: 2.1 time: 0.153320 Jul 20 09:40:23.193558 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 298/579] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:23 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:23.528818 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:23.529991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:23.536451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:23.536882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:23.537865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:23.538287 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:23.672793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:23.680658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:23.682156 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:23.683242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ca4abb01-84d1-4d5d-8673-471af2331f15 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.158295 Jul 20 09:40:23.683862 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 282/580] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:23 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:24.210440 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:24.211050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:24.217520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.217965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.218712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.219141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.346513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:24.354660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f75d4b2f-34a5-458e-8e06-7c2bec7b0082 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1712 microversion: 2.1 time: 0.148075 Jul 20 09:40:24.355223 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 299/581] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:24 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:24.456605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:24.457095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:24.463167 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.463581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.464324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.464745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.482586 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:24.547115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] HTTP exception thrown: Cannot 'detach_volume' instance b2276d91-021a-48eb-b539-ac70600ccf61 while it is in vm_state rescued Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Request method failure captured: Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments/656d7cc0-698c-4ba9-ba51-989991ac49f9 HTTP/1.1 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18yApCWSG7CZNcKwNsvojyCIz8Qj1uogJ1jRxT7bKIadu7R1lE674yOpVPifg7pqW_SfO99g-cVxOe0F8X7COFTPA0dP4ar7VR930nbNiJOhl57Q_DM0aobdI62yLm65t_ck13d8aGzH6OEIK5kMijKZi720Risf_XZ_lJy2XfTl1uM Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:40:24.548745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}] Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: bc74ebac003a4f828fdb44db6dc42887 Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:40:24.550280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Cannot 'detach_volume' instance b2276d91-021a-48eb-b539-ac70600ccf61 while it is in vm_state rescued Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'server_id': 'b2276d91-021a-48eb-b539-ac70600ccf61', 'id': '656d7cc0-698c-4ba9-ba51-989991ac49f9'} Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2276d91-021a-48eb-b539-ac70600ccf61 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:40:24.551104 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b2276d91-021a-48eb-b539-ac70600ccf61 while it is in vm_state rescued Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b2276d91-021a-48eb-b539-ac70600ccf61 while it is in vm_state rescued Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:40:24.553057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Returning 409 to user: Cannot 'detach_volume' instance b2276d91-021a-48eb-b539-ac70600ccf61 while it is in vm_state rescued {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:40:24.554231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b8e8897a-856b-429a-a9fa-cb027a61e637 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments/656d7cc0-698c-4ba9-ba51-989991ac49f9" status: 409 len: 152 microversion: 2.1 time: 0.097559 Jul 20 09:40:24.554231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 283/582] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:40:24 2022] DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments/656d7cc0-698c-4ba9-ba51-989991ac49f9 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:40:24.559020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:24.559632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:24.565853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.566295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.567042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.567507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.631611 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8db2f8aa-c4f8-4318-bdfd-6607606f5b00 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/action" status: 202 len: 0 microversion: 2.1 time: 0.076212 Jul 20 09:40:24.632484 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 300/583] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:40:24 2022] POST /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:40:24.640659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:24.641263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:24.648211 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.648656 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.649410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.649848 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.702735 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:24.703523 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:24.710541 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.711136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.712051 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:24.712485 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:24.855508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:24.863929 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:24.864497 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:24.865430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:24.866532 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5203011c-1f42-4ca0-9424-4f89179abf49 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.168329 Jul 20 09:40:24.867355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 301/584] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:24 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:24.872485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e8f8f34c-9dc1-4a2e-bdfd-35170c78ce07 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1720 microversion: 2.1 time: 0.235694 Jul 20 09:40:24.874068 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 284/585] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:24 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:25.885595 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:25.886203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:25.889527 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:25.890289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:25.892892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:25.893341 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:25.894097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:25.894525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:25.896793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:25.897240 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:25.898021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:25.898486 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:26.024184 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:26.030998 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:26.032661 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:26.034352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:26.035502 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c8dc6112-ca69-46cc-bc31-92b5a996a8f5 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.153753 Jul 20 09:40:26.036055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 302/586] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:25 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:26.039405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fb9c2735-10e6-4ef8-ac15-7fe7e7a20836 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1720 microversion: 2.1 time: 0.153642 Jul 20 09:40:26.040050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 285/587] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:25 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:27.054069 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:27.054695 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:27.058123 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:27.058941 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:27.062108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:27.062833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:27.063315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:27.063743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:27.065974 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:27.066606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:27.067402 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:27.069287 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:27.211102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:27.214253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:27.222710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:27.224328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:27.225383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c850ab2d-687e-4948-806d-516afa526928 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1720 microversion: 2.1 time: 0.171778 Jul 20 09:40:27.225531 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fa143db1-9bf9-4544-b8d9-b8320d5d354d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.175319 Jul 20 09:40:27.225935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 286/589] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:27 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:27.226074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 303/589] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:27 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:27.236536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-bc8b5ff2-4e1f-45f5-b480-395f11983f61 req-aff7ef9b-837c-4044-8c7c-041bf59f866a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "name": "network-vif-plugged", "status": "completed", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:27.244182 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bc8b5ff2-4e1f-45f5-b480-395f11983f61 req-aff7ef9b-837c-4044-8c7c-041bf59f866a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:27.244610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bc8b5ff2-4e1f-45f5-b480-395f11983f61 req-aff7ef9b-837c-4044-8c7c-041bf59f866a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:27.257439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-bc8b5ff2-4e1f-45f5-b480-395f11983f61 req-aff7ef9b-837c-4044-8c7c-041bf59f866a service nova] Creating event network-vif-plugged:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:40:27.262075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-bc8b5ff2-4e1f-45f5-b480-395f11983f61 req-aff7ef9b-837c-4044-8c7c-041bf59f866a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029042 Jul 20 09:40:27.262625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 304/590] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:28.240618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:28.243363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:28.244029 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:28.245465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:28.245850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:28.246382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:28.246506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:28.253588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.253770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.254033 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.254140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.254771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.254891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.255190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.255315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.386669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:28.386917 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:28.395417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0d9380b7-d980-4220-904f-00bcdc42e4b6 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1726 microversion: 2.1 time: 0.155940 Jul 20 09:40:28.395855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:28.395971 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 287/591] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:28 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:28.397501 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:28.398699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2226d8f7-16ad-42da-97ee-f0af4a4b3a89 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1405 microversion: 2.20 time: 0.159114 Jul 20 09:40:28.399448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 305/592] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:28 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:28.411598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:28.412283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:28.418255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.418703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.419563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:28.419997 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:28.495552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-94369d0a-dcba-46ee-b581-babb47c8dc93 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087845 Jul 20 09:40:28.496140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 288/593] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:40:28 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:29.362677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-a842a822-73ac-469f-8001-141d819f0337 req-98782cb9-7f51-4647-9ee0-eeb803020ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:29.372099 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-a842a822-73ac-469f-8001-141d819f0337 req-98782cb9-7f51-4647-9ee0-eeb803020ad1 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:29.373156 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-a842a822-73ac-469f-8001-141d819f0337 req-98782cb9-7f51-4647-9ee0-eeb803020ad1 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:29.384576 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-a842a822-73ac-469f-8001-141d819f0337 req-98782cb9-7f51-4647-9ee0-eeb803020ad1 service nova] Creating event network-changed:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:40:29.389791 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-a842a822-73ac-469f-8001-141d819f0337 req-98782cb9-7f51-4647-9ee0-eeb803020ad1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035080 Jul 20 09:40:29.390645 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 306/594] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:29.418399 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:29.420881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:29.428001 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:29.428769 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:29.429606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:29.430110 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:29.651852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:29.660144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:29.661697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:29.663108 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c50524cb-1668-41d8-bcb5-72bba533cd48 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1597 microversion: 2.20 time: 0.250005 Jul 20 09:40:29.675787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 289/595] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:40:29 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1597 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:40:29.684035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:29.684608 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:29.691607 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:29.692048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:29.692800 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:29.693224 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:29.773453 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bfe58153-2cb1-4273-8c83-b40bbd61eaf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095327 Jul 20 09:40:29.774297 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 307/596] 10.222.0.18 () {60 vars in 1315 bytes} [Wed Jul 20 09:40:29 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:40:30.921404 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-0eaa2330-c96f-41d9-aba5-185729e5c28e req-5bf9a0d6-72ca-4fef-ae29-f8389b01762d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:30.929945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-0eaa2330-c96f-41d9-aba5-185729e5c28e req-5bf9a0d6-72ca-4fef-ae29-f8389b01762d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:30.930386 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-0eaa2330-c96f-41d9-aba5-185729e5c28e req-5bf9a0d6-72ca-4fef-ae29-f8389b01762d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:30.941894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-0eaa2330-c96f-41d9-aba5-185729e5c28e req-5bf9a0d6-72ca-4fef-ae29-f8389b01762d service nova] Creating event network-changed:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:40:30.946823 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-0eaa2330-c96f-41d9-aba5-185729e5c28e req-5bf9a0d6-72ca-4fef-ae29-f8389b01762d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029593 Jul 20 09:40:30.947890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 290/597] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:31.412544 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-b313e8db-df02-4e35-9df9-2840fbea09af req-19fc918c-c8be-4ebb-ae03-2af4873e4590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:31.420713 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-b313e8db-df02-4e35-9df9-2840fbea09af req-19fc918c-c8be-4ebb-ae03-2af4873e4590 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:31.421246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-b313e8db-df02-4e35-9df9-2840fbea09af req-19fc918c-c8be-4ebb-ae03-2af4873e4590 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:31.435392 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-b313e8db-df02-4e35-9df9-2840fbea09af req-19fc918c-c8be-4ebb-ae03-2af4873e4590 service nova] Creating event network-changed:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:40:31.439328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-b313e8db-df02-4e35-9df9-2840fbea09af req-19fc918c-c8be-4ebb-ae03-2af4873e4590 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030292 Jul 20 09:40:31.439328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 308/598] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:36.309768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:36.310858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:36.317936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:36.318374 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:36.319113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:36.319622 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:36.397221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cbfa370b-2656-422d-ba15-2c8df0eff937 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action" status: 202 len: 0 microversion: 2.1 time: 0.091644 Jul 20 09:40:36.397892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 291/599] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:40:36 2022] POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:40:36.408087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:36.408571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:36.416682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:36.417203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:36.418157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:36.418633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:36.577741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:36.586613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e54a750b-cb11-48c4-b19c-c5b0d7d53230 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1748 microversion: 2.1 time: 0.183756 Jul 20 09:40:36.587194 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 309/600] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:36 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1748 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:37.606168 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:37.606872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:37.613239 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:37.613684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:37.614441 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:37.614855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:37.755391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:37.763811 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-364bc662-6286-43cb-9117-fbef70ee477a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.162196 Jul 20 09:40:37.764363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 292/601] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:37 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:38.781769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:38.782381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:38.789316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:38.789760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:38.790508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:38.790941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:38.936664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:38.944583 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3d67c1f1-6623-49de-9326-de85d2a66714 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.167224 Jul 20 09:40:38.945168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 310/602] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:38 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:39.962128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:39.962729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:39.969888 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:39.970356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:39.971093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:39.971552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:40.117510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:40.125940 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d5f3ca40-046a-431b-ab7d-b26357cc9b9b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.168565 Jul 20 09:40:40.126500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 293/603] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:39 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:41.143571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:41.144197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:41.150612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:41.151050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:41.151824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:41.152251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:41.292198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:41.300658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4f2ee20e-6d8a-47c6-b4ab-6d654bc8a718 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.161061 Jul 20 09:40:41.301265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 311/604] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:41 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:42.238231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:42.239153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:42.245563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.246054 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.246812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.247444 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.277664 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5219c3e6-6250-4028-8adb-21fd563661ea tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043374 Jul 20 09:40:42.278762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 294/605] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:40:42 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:40:42.318170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:42.318900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:42.330031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.330478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.331605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.332036 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.335901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:42.336427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:42.343423 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.343955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.344697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.345118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.369969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:40:42.460011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f72c4d5a-e60f-4dbb-8668-92464d666e7f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 204 len: 0 microversion: 2.1 time: 0.127523 Jul 20 09:40:42.460598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 295/606] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:40:42 2022] DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:40:42.469051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:42.469773 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:42.475470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.475912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.476660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:42.477088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:42.488997 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:42.498026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c9ab7aa6-3061-41e7-8568-49826336a597 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.183504 Jul 20 09:40:42.498605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 312/607] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:42 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:42.609469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:42.616987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6b6b4fcb-d9f6-4e46-9855-efc1d6daa4bd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1674 microversion: 2.1 time: 0.152058 Jul 20 09:40:42.617550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 296/608] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:42 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:43.514981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:43.515615 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:43.518037 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:43.523165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:43.523632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:43.524372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:43.524797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:43.633793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:43.634472 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:43.641458 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:43.641980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:43.642869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:43.643397 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:43.666114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:43.674395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4f6c4af1-c6db-4da7-aed7-71d4d5bbc30a tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.163188 Jul 20 09:40:43.674969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 313/609] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:43 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:43.775460 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:43.783585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-03bafaa6-a61c-4f33-9112-166a6a3a6c4f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1674 microversion: 2.1 time: 0.153574 Jul 20 09:40:43.784147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 297/610] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:43 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:44.747605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:44.748152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:44.754912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:44.755441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:44.756197 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:44.756626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:44.801108 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:44.801726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:44.808614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:44.809051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:44.809805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:44.810228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:44.829263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:44.904824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:44.913554 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-704878c6-cc9e-49af-add3-f359ee4a0fbc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.169932 Jul 20 09:40:44.914117 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 314/611] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:44 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:45.044475 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:45.052561 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3967549e-9a16-4c84-8e75-bfe1403abf41 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 200 len: 1674 microversion: 2.1 time: 0.255286 Jul 20 09:40:45.053121 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 298/612] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:44 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:45.544451 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-07a57ea7-a1ea-4302-911e-762ae56642e6 req-6636d064-57c8-4eff-8c1e-2e3f1a694c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09550419-8417-4448-af4b-10d9534548a4", "name": "network-vif-deleted", "tag": "77eb85d9-70f1-486d-aade-4ad658042670"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:45.555557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-07a57ea7-a1ea-4302-911e-762ae56642e6 req-6636d064-57c8-4eff-8c1e-2e3f1a694c9a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:45.556016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-07a57ea7-a1ea-4302-911e-762ae56642e6 req-6636d064-57c8-4eff-8c1e-2e3f1a694c9a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:45.560498 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:45.571320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-07a57ea7-a1ea-4302-911e-762ae56642e6 req-6636d064-57c8-4eff-8c1e-2e3f1a694c9a service nova] Creating event network-vif-deleted:77eb85d9-70f1-486d-aade-4ad658042670 for instance 09550419-8417-4448-af4b-10d9534548a4 on hv-cinder-82282 Jul 20 09:40:45.576679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-07a57ea7-a1ea-4302-911e-762ae56642e6 req-6636d064-57c8-4eff-8c1e-2e3f1a694c9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036704 Jul 20 09:40:45.577283 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 315/613] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:45.931469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:45.932197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:45.939017 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:45.939492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:45.940278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:45.940886 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:46.072064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:46.073677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:46.084122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:46.084958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:46.085964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:46.086617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:46.104789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:40:46.106412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 HTTP/1.1 Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:40:46.107015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:40:46.108353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '09550419-8417-4448-af4b-10d9534548a4'} Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:40:46.109104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:40:46.110361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:40:46.112988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:40:46.114079 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-40be007e-4094-4787-90ae-29e4a1a0886d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 404 len: 111 microversion: 2.1 time: 0.047477 Jul 20 09:40:46.115395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cea48752-7398-450b-b18e-ea880934bc60 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.187742 Jul 20 09:40:46.119330 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 299/614] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:45 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:46.119506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 316/615] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:46 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:40:46.123912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-47839477-110a-4184-8916-6de4aa854d55 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '.version_select at 0x7f81f44965e0>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:46.142824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-47839477-110a-4184-8916-6de4aa854d55 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054059781" status: 202 len: 0 microversion: 2.1 time: 0.023192 Jul 20 09:40:46.143451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 300/616] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jul 20 09:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054059781 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:40:46.810886 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ea42e4ef-b108-4cf0-b7bc-96b527fbedd9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: .version_select at 0x7f81f42ec670>, body: {"keypair": {"name": "tempest-keypair-164482320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiBBtVcgdLa8LZFWv+3yXchZemWovVxUbsomgelliX+prPH+fO2E3Bj/NbfglrwWaRldRWSqxPVNaDe/sXdAM3oyzv7ogZxXeeaVgeh1WYBaURe7rBE9pPa6v03ajRrtA=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:46.826200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-ea42e4ef-b108-4cf0-b7bc-96b527fbedd9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for project e068f9b959004be4ad9c778d9010561a. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:40:46.830058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-ea42e4ef-b108-4cf0-b7bc-96b527fbedd9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for user ee885a29e6fa4b1980d7ae1d03b2b476 and project e068f9b959004be4ad9c778d9010561a. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:40:46.851635 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ea42e4ef-b108-4cf0-b7bc-96b527fbedd9 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044860 Jul 20 09:40:46.852152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 317/617] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:40:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:47.133158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:47.133766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:47.141265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:47.141969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:47.143135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:47.145410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:47.348457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:47.356909 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-58fb16ef-f7d9-440a-8acc-087fe64f04eb tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.227774 Jul 20 09:40:47.357467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 301/618] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:47 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:48.258391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1411690954", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36a1bf85-9a28-4e91-952b-126a8641e41e"}], "security_groups": [{"name": "tempest-securitygroup--1116686769"}], "key_name": "tempest-keypair-164482320", "user_data": "}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:48.359855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] validate_networks() for [('36a1bf85-9a28-4e91-952b-126a8641e41e', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:40:48.374704 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:48.375329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:48.377690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:48.382792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:48.383234 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:48.384026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:48.384455 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:48.537616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:48.546517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-85c0ce0f-7c51-4195-83f9-3d5e7aeca3bc tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1753 microversion: 2.1 time: 0.176564 Jul 20 09:40:48.547094 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 302/619] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:48 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:48.750139 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:40:48.750561 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:40:48.751034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:40:48.751489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:40:48.751907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:40:48.760688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:48.761131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:48.761921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:48.762464 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:48.779231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for project e068f9b959004be4ad9c778d9010561a. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:40:48.783135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Getting quotas for user ee885a29e6fa4b1980d7ae1d03b2b476 and project e068f9b959004be4ad9c778d9010561a. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:40:48.794925 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:40:48.797199 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:40:48.844043 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6f6bf420-7144-46b2-982f-3ccc9bd8729c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590446 Jul 20 09:40:48.844683 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 318/620] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:40:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:40:48.854474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b8fba244-e3eb-410a-91be-6d2ffc1175eb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:48.855079 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b8fba244-e3eb-410a-91be-6d2ffc1175eb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:48.912901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b8fba244-e3eb-410a-91be-6d2ffc1175eb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:48.919716 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b8fba244-e3eb-410a-91be-6d2ffc1175eb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1237 microversion: 2.1 time: 0.068957 Jul 20 09:40:48.920282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 303/621] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:48 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:49.565349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:49.565867 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:49.572522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:49.572960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:49.573701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:49.574125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:49.725408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:49.735672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a4e30fd8-ccab-4276-948f-836cff09188b tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1756 microversion: 2.1 time: 0.174936 Jul 20 09:40:49.736247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 319/622] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:49 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:49.938203 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:49.939439 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:49.946895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:49.947381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:49.948141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:49.948569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:50.013603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:50.020822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-078292a5-cc64-40c1-b431-228c869c0032 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1295 microversion: 2.1 time: 0.087569 Jul 20 09:40:50.021382 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 304/623] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:49 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:40:51.038435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:51.039225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:51.046898 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:51.047453 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:51.048301 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:51.048856 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:51.182421 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:51.190552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9fe4c850-15e9-47ed-98a2-27d4bab7dead tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.156299 Jul 20 09:40:51.191145 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 320/624] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:51 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:51.610317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-b73a1934-1344-4203-8618-918aead0e91f req-ea3f7613-9a25-43ec-aaf6-a8efba2665a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc4383c-74cf-41bd-a13b-645e0dec5e66", "tag": "87539666-3759-4a90-a2d8-d12fe5a15433"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:51.620374 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b73a1934-1344-4203-8618-918aead0e91f req-ea3f7613-9a25-43ec-aaf6-a8efba2665a9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:51.621416 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b73a1934-1344-4203-8618-918aead0e91f req-ea3f7613-9a25-43ec-aaf6-a8efba2665a9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:51.634073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-b73a1934-1344-4203-8618-918aead0e91f req-ea3f7613-9a25-43ec-aaf6-a8efba2665a9 service nova] Creating event network-changed:87539666-3759-4a90-a2d8-d12fe5a15433 for instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 on hv-cinder-82282 Jul 20 09:40:51.638937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-b73a1934-1344-4203-8618-918aead0e91f req-ea3f7613-9a25-43ec-aaf6-a8efba2665a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Jul 20 09:40:51.641150 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 305/625] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:52.207388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:52.207926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:52.214362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:52.214811 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:52.215625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:52.216053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:52.348058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:52.355361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1b704af6-85c1-4032-b501-0126349e8f96 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.151975 Jul 20 09:40:52.355951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 321/626] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:52 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:53.373630 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:53.374412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:53.380507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:53.380939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:53.381696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:53.382122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:53.579052 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:53.586508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-44708866-3c14-497b-98d2-366b4e6e5695 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.217742 Jul 20 09:40:53.587074 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 306/627] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:53 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:54.603977 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:54.604592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:54.612027 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:54.612565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:54.613329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:54.613756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:54.742452 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:54.749972 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b48f49b6-442c-4b61-82e0-66cb2cca7495 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.149830 Jul 20 09:40:54.750545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 322/628] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:54 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:55.259002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-93dc1de7-142a-4153-9d15-4f7b6e314526 req-630ab977-3015-43a0-888d-e5eae016ef54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc4383c-74cf-41bd-a13b-645e0dec5e66", "name": "network-vif-plugged", "status": "completed", "tag": "87539666-3759-4a90-a2d8-d12fe5a15433"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:55.270061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-93dc1de7-142a-4153-9d15-4f7b6e314526 req-630ab977-3015-43a0-888d-e5eae016ef54 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:55.270540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-93dc1de7-142a-4153-9d15-4f7b6e314526 req-630ab977-3015-43a0-888d-e5eae016ef54 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:55.284471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-93dc1de7-142a-4153-9d15-4f7b6e314526 req-630ab977-3015-43a0-888d-e5eae016ef54 service nova] Creating event network-vif-plugged:87539666-3759-4a90-a2d8-d12fe5a15433 for instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 on hv-cinder-82282 Jul 20 09:40:55.289582 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-93dc1de7-142a-4153-9d15-4f7b6e314526 req-630ab977-3015-43a0-888d-e5eae016ef54 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 Jul 20 09:40:55.290422 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 307/629] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:40:55.766803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:55.767500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:55.773758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:55.774195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:55.774936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:55.775390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:55.907458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:55.914968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4c0faec1-6e76-4ef0-80b4-305fdeffd13c tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.152161 Jul 20 09:40:55.915548 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 323/630] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:55 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:56.932959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:56.933639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:56.941246 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:56.941709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:56.942451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:56.942874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:57.198166 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:57.205529 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-df316062-64a0-41e2-9243-ddb9d6ae8bcd tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1363 microversion: 2.1 time: 0.276796 Jul 20 09:40:57.206088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 308/631] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:56 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:58.221912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:58.222516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:58.229027 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:58.229474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:58.230222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:58.230652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:58.359540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:40:58.367076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f5eb9f85-f93f-4ce9-9ab5-d69fdc646204 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1548 microversion: 2.1 time: 0.148966 Jul 20 09:40:58.367679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 324/632] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:40:58 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:40:58.383833 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:40:58.384333 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:40:58.391216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:58.391683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:58.392420 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:58.392841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:58.470734 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fe1ca6fe-4e1b-4423-b8a2-2ae978e9faba tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090642 Jul 20 09:40:58.471345 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 309/633] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:40:58 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:40:59.597409 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-da321a3a-e008-4ea5-b376-3348648856b1 req-1c0830ce-1a7e-4eb7-aeff-9d8d6b376a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc4383c-74cf-41bd-a13b-645e0dec5e66", "tag": "87539666-3759-4a90-a2d8-d12fe5a15433"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:40:59.601093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:59.601899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=10 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:40:59.609202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-da321a3a-e008-4ea5-b376-3348648856b1 req-1c0830ce-1a7e-4eb7-aeff-9d8d6b376a1b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:40:59.609648 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-da321a3a-e008-4ea5-b376-3348648856b1 req-1c0830ce-1a7e-4eb7-aeff-9d8d6b376a1b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:40:59.620438 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-da321a3a-e008-4ea5-b376-3348648856b1 req-1c0830ce-1a7e-4eb7-aeff-9d8d6b376a1b service nova] Creating event network-changed:87539666-3759-4a90-a2d8-d12fe5a15433 for instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 on hv-cinder-82282 Jul 20 09:40:59.625826 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-da321a3a-e008-4ea5-b376-3348648856b1 req-1c0830ce-1a7e-4eb7-aeff-9d8d6b376a1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Jul 20 09:40:59.626435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 325/634] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:07.374436 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:07.379885 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:07.380376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:07.386602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:07.387046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:07.387827 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:07.388257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:07.467352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lazy-loading 'services' on Instance uuid b2276d91-021a-48eb-b539-ac70600ccf61 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:41:07.536421 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-66b896f9-ab9c-4d3e-a889-0b5bd1b0dc0c tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments/656d7cc0-698c-4ba9-ba51-989991ac49f9" status: 202 len: 0 microversion: 2.1 time: 0.162548 Jul 20 09:41:07.537250 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 310/635] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:41:07 2022] DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments/656d7cc0-698c-4ba9-ba51-989991ac49f9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:41:07.548235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:07.549264 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:07.555820 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:07.556255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:07.557220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:07.557706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:07.591149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3b1f9e3d-321d-4340-9954-7ed90e135663 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048720 Jul 20 09:41:07.591741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 326/636] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:41:07 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:08.603932 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:08.604825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:08.611454 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.611890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.612630 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.613046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.642477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1dcb8a33-ae45-4ba3-a888-b1625b4fe422 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043402 Jul 20 09:41:08.643044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 311/637] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:41:08 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:41:08.717902 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:08.718436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:08.724876 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.725323 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.726075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.726509 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.751912 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:41:08.826398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6b990e43-0791-4fbc-ba31-23c19e2b42fb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 204 len: 0 microversion: 2.1 time: 0.112737 Jul 20 09:41:08.827155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 327/638] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:41:08 2022] DELETE /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:08.835862 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:08.836494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:08.843495 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.844037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.844797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:08.845231 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:08.972973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:08.981191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3818623e-8328-4682-a324-f4bc00470d5e tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1686 microversion: 2.1 time: 0.149441 Jul 20 09:41:08.981762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 312/639] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:08 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:09.999195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:09.999918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:10.006416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:10.006863 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:10.007649 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:10.008080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:10.187114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:10.194542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b7adaf58-6daf-43c5-9316-88ebdaf1c4e9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1686 microversion: 2.1 time: 0.200171 Jul 20 09:41:10.195113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 328/640] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:09 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:11.211470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:11.212098 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:11.219453 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:11.219893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:11.220634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:11.221058 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:11.354315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:11.361912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-57c32bbb-2f40-4afc-ba3c-e5ceec407afa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1686 microversion: 2.1 time: 0.154323 Jul 20 09:41:11.362405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 313/641] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:11 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:12.378632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:12.379217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:12.385625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:12.386064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:12.387171 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:12.387697 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:12.521190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:12.529427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9e9c820b-2fce-4a27-b6d3-b83121e08396 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1686 microversion: 2.1 time: 0.154717 Jul 20 09:41:12.529986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 329/642] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:12 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:13.546678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:13.547316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:13.553975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:13.554943 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:13.555366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:13.555868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:13.635899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:13.637008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-78bbcdf0-eb90-41c5-8e02-8e15317ce2d7 req-2492abd2-ce98-47b9-b0e8-d622a528b163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2276d91-021a-48eb-b539-ac70600ccf61", "name": "network-vif-deleted", "tag": "94c684db-cb6a-480b-89c3-6faeb0c7a54f"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:13.642469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:13.644403 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f07bf83d-4b74-4750-9b6c-879189f3e244 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 200 len: 1620 microversion: 2.1 time: 0.101807 Jul 20 09:41:13.645355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 314/643] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:13 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 1620 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:13.651755 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-78bbcdf0-eb90-41c5-8e02-8e15317ce2d7 req-2492abd2-ce98-47b9-b0e8-d622a528b163 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:13.653372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-78bbcdf0-eb90-41c5-8e02-8e15317ce2d7 req-2492abd2-ce98-47b9-b0e8-d622a528b163 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:13.667267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-78bbcdf0-eb90-41c5-8e02-8e15317ce2d7 req-2492abd2-ce98-47b9-b0e8-d622a528b163 service nova] Creating event network-vif-deleted:94c684db-cb6a-480b-89c3-6faeb0c7a54f for instance b2276d91-021a-48eb-b539-ac70600ccf61 on hv-cinder-82282 Jul 20 09:41:13.673385 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-78bbcdf0-eb90-41c5-8e02-8e15317ce2d7 req-2492abd2-ce98-47b9-b0e8-d622a528b163 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040558 Jul 20 09:41:13.674206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 330/644] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:14.580650 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:14.582080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:14.590468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:14.590908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:14.591759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:14.592189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:14.619844 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-86ddd399-0830-4056-8456-d20bae1d3a68 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/ips" status: 200 len: 151 microversion: 2.20 time: 0.110674 Jul 20 09:41:14.620411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 315/645] 10.222.0.18 () {60 vars in 1288 bytes} [Wed Jul 20 09:41:14 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/ips => generated 151 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:41:14.664567 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:14.665405 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: b2276d91-021a-48eb-b539-ac70600ccf61] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:14.672716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:14.674938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:14.675742 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:14.676173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:14.695485 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] HTTP exception thrown: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Request method failure captured: Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 HTTP/1.1 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yApCWSG7CZNcKwNsvojyCIz8Qj1uogJ1jRxT7bKIadu7R1lE674yOpVPifg7pqW_SfO99g-cVxOe0F8X7COFTPA0dP4ar7VR930nbNiJOhl57Q_DM0aobdI62yLm65t_ck13d8aGzH6OEIK5kMijKZi720Risf_XZ_lJy2XfTl1uM Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:41:14.697343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}] Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: bc74ebac003a4f828fdb44db6dc42887 Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. Jul 20 09:41:14.698891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'b2276d91-021a-48eb-b539-ac70600ccf61'} Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:14.700234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. Jul 20 09:41:14.701975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:14.704771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Returning 404 to user: Instance b2276d91-021a-48eb-b539-ac70600ccf61 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:14.704771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2d09afaf-a221-42e1-9a53-d682c7d20408 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61" status: 404 len: 111 microversion: 2.1 time: 0.039480 Jul 20 09:41:14.704771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 331/646] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:14 2022] GET /compute/v2.1/servers/b2276d91-021a-48eb-b539-ac70600ccf61 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:41:14.713457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3fa869b2-29ed-4334-8050-ee4832c30169 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '.version_select at 0x7f81f43e5700>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:14.735465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3fa869b2-29ed-4334-8050-ee4832c30169 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95979179" status: 202 len: 0 microversion: 2.1 time: 0.029991 Jul 20 09:41:14.736262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 316/647] 10.222.0.18 () {58 vars in 1214 bytes} [Wed Jul 20 09:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95979179 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:41:16.507259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:16.507814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:16.514792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:16.515237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:16.516012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:16.516445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:16.518871 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:16.541141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lazy-loading 'flavor' on Instance uuid 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:41:16.800348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-649464fd-a2d6-44ce-8c8c-141d8d2417ea tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/action" status: 202 len: 0 microversion: 2.20 time: 0.296800 Jul 20 09:41:16.801007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 332/648] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jul 20 09:41:16 2022] POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:16.811739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:16.812551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:16.820103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:16.820639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:16.821448 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:16.821951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:16.829759 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:16.963624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:16.972230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:16.973755 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:16.974891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7648cd22-db39-4e7e-b19c-e5e27d56e3f1 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.169508 Jul 20 09:41:16.975722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 317/649] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:16 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:17.719946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:17.720516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:17.726632 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:17.727069 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:17.727830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:17.728251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:17.753565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:41:17.828958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c13a2ccf-e6ba-4d45-81c8-dcdb5b830c73 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 204 len: 0 microversion: 2.1 time: 0.113828 Jul 20 09:41:17.829786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 333/650] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:41:17 2022] DELETE /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:17.837929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:17.838675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:17.845574 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:17.846096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:17.846851 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:17.847279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:17.978037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:17.985460 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c39b0d29-97df-4991-8386-3281ca585af2 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1509 microversion: 2.1 time: 0.151568 Jul 20 09:41:17.986079 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 318/651] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:17 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:17.994325 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:17.995016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:18.001733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:18.002178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:18.002930 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:18.003383 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:18.133452 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:18.141448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:18.142953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:18.144137 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-31295679-c47a-48bf-baff-c24579d5dc1d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.154024 Jul 20 09:41:18.144687 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 334/652] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:17 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:19.002417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:19.003026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:19.005350 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:19.010541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:19.010986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:19.012264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:19.012692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:19.140629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:19.148019 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e1182366-745e-4e6b-9a80-59453503a80a tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1509 microversion: 2.1 time: 0.149435 Jul 20 09:41:19.148586 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 319/653] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:18 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:19.161729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:19.162585 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:19.169087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:19.169528 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:19.170272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:19.170730 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:19.302223 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:19.312012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:19.313526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:19.314677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6344454c-fe51-414c-9a45-be3aaa576b3a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.156802 Jul 20 09:41:19.315233 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 335/654] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:19 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:20.166024 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:20.166649 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:20.173214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:20.173648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:20.174385 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:20.174806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:20.306015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:20.313524 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3445c607-7595-4912-91b1-94374e159a57 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1509 microversion: 2.1 time: 0.151740 Jul 20 09:41:20.314086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 320/655] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:20 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:20.333251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:20.333913 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:20.341180 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:20.341626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:20.342376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:20.342808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:20.471772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:20.479576 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:20.481112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:20.482256 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-52214696-28a9-4d96-a789-a649350f17d9 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.152864 Jul 20 09:41:20.482804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 336/656] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:20 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:20.911473 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-538266ed-63e7-418e-a807-26fb346ee1ac req-cc47896d-af25-4a61-ae92-3ae1ca00126c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ab6169-0ddb-45df-a77d-e9ab309261b1", "name": "network-vif-deleted", "tag": "d3d9760d-e62d-4793-afa5-a0990048268c"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:20.923533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-538266ed-63e7-418e-a807-26fb346ee1ac req-cc47896d-af25-4a61-ae92-3ae1ca00126c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:20.923992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-538266ed-63e7-418e-a807-26fb346ee1ac req-cc47896d-af25-4a61-ae92-3ae1ca00126c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:20.938121 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-538266ed-63e7-418e-a807-26fb346ee1ac req-cc47896d-af25-4a61-ae92-3ae1ca00126c service nova] Creating event network-vif-deleted:d3d9760d-e62d-4793-afa5-a0990048268c for instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 on hv-cinder-82282 Jul 20 09:41:20.943165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-538266ed-63e7-418e-a807-26fb346ee1ac req-cc47896d-af25-4a61-ae92-3ae1ca00126c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Jul 20 09:41:20.943795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 321/657] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:21.330318 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:21.330933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:21.337563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:21.338217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:21.338818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:21.339430 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:21.374793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:21.376212 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:21.376668 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lazy-loading 'fault' on Instance uuid 29ab6169-0ddb-45df-a77d-e9ab309261b1 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:41:21.419807 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:21.426837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c889a3b4-03f8-444a-8f75-abe2a1dc8f3f tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 200 len: 1312 microversion: 2.1 time: 0.100286 Jul 20 09:41:21.427580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 337/658] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:21 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:21.500915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:21.501623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:21.508190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:21.508617 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:21.509369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:21.509797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:21.643041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:21.650907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:21.653012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:21.654160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-374419ae-88a4-4a3d-aaa4-3e3815439cf4 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.157595 Jul 20 09:41:21.654717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 322/659] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:21 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:22.444418 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:22.445053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 29ab6169-0ddb-45df-a77d-e9ab309261b1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:22.452296 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.452746 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.453552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.453984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.467105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] HTTP exception thrown: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Request method failure captured: Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 HTTP/1.1 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18yApCWSG7CZNcKwNsvojyCIz8Qj1uogJ1jRxT7bKIadu7R1lE674yOpVPifg7pqW_SfO99g-cVxOe0F8X7COFTPA0dP4ar7VR930nbNiJOhl57Q_DM0aobdI62yLm65t_ck13d8aGzH6OEIK5kMijKZi720Risf_XZ_lJy2XfTl1uM Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:41:22.468768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}] Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: bc74ebac003a4f828fdb44db6dc42887 Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. Jul 20 09:41:22.470309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '29ab6169-0ddb-45df-a77d-e9ab309261b1'} Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:22.471172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. Jul 20 09:41:22.473152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:22.474530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Returning 404 to user: Instance 29ab6169-0ddb-45df-a77d-e9ab309261b1 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:22.474530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bb3311b2-921c-4c17-ac12-ee726aa975fa tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1" status: 404 len: 111 microversion: 2.1 time: 0.029629 Jul 20 09:41:22.474530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 338/660] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:22 2022] GET /compute/v2.1/servers/29ab6169-0ddb-45df-a77d-e9ab309261b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:41:22.479724 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:22.480244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:22.486342 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.486785 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.487547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.487970 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.513248 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:41:22.584382 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4cfacec3-3fcb-413d-83de-956a27fc06c0 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 204 len: 0 microversion: 2.1 time: 0.108165 Jul 20 09:41:22.585152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 323/661] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:41:22 2022] DELETE /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:22.594637 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:22.595278 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:22.601264 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.601709 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.602460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.602888 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.672913 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:22.673601 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:22.679539 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.679982 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.680760 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:22.681194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:22.737330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:22.745033 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3221887a-32e5-4e33-84ac-66d0a03be217 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.154200 Jul 20 09:41:22.746387 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 339/662] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:22 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:22.817801 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:22.826320 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:22.827904 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:22.829042 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-21fa20b6-bfcd-45a5-8782-4c995007309d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.160494 Jul 20 09:41:22.829599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 324/663] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:22 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:23.763725 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:23.764332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:23.770825 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:23.771268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:23.772053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:23.772483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:23.847908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:23.848504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:23.854929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:23.855779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:23.856804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:23.857243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:23.905289 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:23.913524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5bf760ae-1474-4efc-9645-1a7db21f52bb tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.154240 Jul 20 09:41:23.914093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 340/664] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:23 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:23.993657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:24.002090 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:24.003663 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:24.004813 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3a11053b-7ac0-4df8-9678-3aa1298ba830 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.160784 Jul 20 09:41:24.005366 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 325/665] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:23 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:24.931325 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:24.931936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:24.938909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:24.939378 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:24.940128 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:24.940556 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:25.023514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:25.024117 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:25.030768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:25.031212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:25.032005 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:25.032433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:25.071476 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:25.078981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6e866ac3-82fa-4660-bce1-a301537fced9 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.151418 Jul 20 09:41:25.079593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 341/666] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:24 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:25.159708 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:25.168493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:25.170118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:25.171259 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a0f0f131-c687-41f5-be88-571baac540ed tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.151711 Jul 20 09:41:25.171869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 326/667] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:25 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:26.095802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:26.096401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:26.102709 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:26.103151 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:26.103947 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:26.104374 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:26.190996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:26.191869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:26.198496 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:26.199579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:26.200359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:26.200794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:26.237164 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc74ebac003a4f828fdb44db6dc42887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b4839566df4751bfde1f4975cdcb78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:26.244771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-01430fb9-a395-4e97-b7eb-026dc1c6adb7 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 200 len: 1521 microversion: 2.1 time: 0.152766 Jul 20 09:41:26.245339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 342/668] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:26 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:26.404519 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:26.413500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:26.415032 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:26.416221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-746531b7-6525-44fa-af31-67ac0fe69e57 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.229106 Jul 20 09:41:26.416790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 327/669] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:26 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:26.554344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-ddc98b4c-1064-4bbc-9e07-501b1fe313a7 req-5f0c19df-42db-4282-b267-88dcd55f89cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69dd79a4-13b6-4962-85c9-ab27f895facb", "name": "network-vif-deleted", "tag": "a4b4ceb3-6606-477a-a921-d57e2379731b"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:26.563406 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-ddc98b4c-1064-4bbc-9e07-501b1fe313a7 req-5f0c19df-42db-4282-b267-88dcd55f89cc service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:26.563832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-ddc98b4c-1064-4bbc-9e07-501b1fe313a7 req-5f0c19df-42db-4282-b267-88dcd55f89cc service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:26.575341 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-ddc98b4c-1064-4bbc-9e07-501b1fe313a7 req-5f0c19df-42db-4282-b267-88dcd55f89cc service nova] Creating event network-vif-deleted:a4b4ceb3-6606-477a-a921-d57e2379731b for instance 69dd79a4-13b6-4962-85c9-ab27f895facb on hv-cinder-82282 Jul 20 09:41:26.580203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-ddc98b4c-1064-4bbc-9e07-501b1fe313a7 req-5f0c19df-42db-4282-b267-88dcd55f89cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029434 Jul 20 09:41:26.580782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 343/670] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:27.262600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:27.263180 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] [instance: 69dd79a4-13b6-4962-85c9-ab27f895facb] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:27.269855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:27.270297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:27.271048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:27.271512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:27.285116 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] HTTP exception thrown: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Request method failure captured: Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb HTTP/1.1 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18yApCWSG7CZNcKwNsvojyCIz8Qj1uogJ1jRxT7bKIadu7R1lE674yOpVPifg7pqW_SfO99g-cVxOe0F8X7COFTPA0dP4ar7VR930nbNiJOhl57Q_DM0aobdI62yLm65t_ck13d8aGzH6OEIK5kMijKZi720Risf_XZ_lJy2XfTl1uM Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:41:27.286654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/13b4839566df4751bfde1f4975cdcb78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/13b4839566df4751bfde1f4975cdcb78"}]}] Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 13b4839566df4751bfde1f4975cdcb78 Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2069639578 Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: bc74ebac003a4f828fdb44db6dc42887 Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2069639578-project Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. Jul 20 09:41:27.288465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '69dd79a4-13b6-4962-85c9-ab27f895facb'} Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:27.289371 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. Jul 20 09:41:27.290829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:27.292435 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] Returning 404 to user: Instance 69dd79a4-13b6-4962-85c9-ab27f895facb could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:27.292435 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eaf6f161-767d-4b08-93e1-295fa47d9933 tempest-ServerRescueNegativeTestJSON-2069639578 tempest-ServerRescueNegativeTestJSON-2069639578-project] 10.222.0.18 "GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb" status: 404 len: 111 microversion: 2.1 time: 0.030251 Jul 20 09:41:27.292435 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 328/671] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:27 2022] GET /compute/v2.1/servers/69dd79a4-13b6-4962-85c9-ab27f895facb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:41:27.435901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:27.436626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:27.443026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:27.443813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:27.444380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:27.444819 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:27.656234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:27.664364 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:27.665875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:27.667031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fbb8333b-a358-45a4-b029-b6556737c895 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.236827 Jul 20 09:41:27.667849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 344/672] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:27 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:28.685474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:28.686080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:28.692663 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:28.693105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:28.693858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:28.694278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:28.827242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:28.835251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:28.836780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:28.837926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f8f1d7b3-e92c-412b-82d2-918a16d40f7f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.156629 Jul 20 09:41:28.838479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 329/673] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:28 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:29.856942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:29.857675 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:29.867814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:29.868297 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:29.869065 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:29.869497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:30.081737 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:30.089602 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:30.091095 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:30.092254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2a8eef6a-e2e1-4880-a344-334989c081a0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.239326 Jul 20 09:41:30.092804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 345/674] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:29 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:31.110491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:31.111129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:31.117580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:31.118028 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:31.118783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:31.119312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:31.273672 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:31.293666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:31.296456 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:31.298590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-93ad6c9a-74f8-4dc8-a329-746e1c7ad114 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.191612 Jul 20 09:41:31.299638 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 330/675] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:31 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:31.897177 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-129d4d7c-343b-4b0f-a256-03a3a1cf4795 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Action: 'create', calling method: .version_select at 0x7f81f4310550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1992691764", "metadata": {"Type": "work"}}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:32.182621 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-129d4d7c-343b-4b0f-a256-03a3a1cf4795 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.400213 Jul 20 09:41:32.184095 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 346/676] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jul 20 09:41:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 402 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 09:41:32.195894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ec9fc9b5-f377-4c92-85b3-8134b09cdd9a tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f43c9ee0>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:32.248187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ec9fc9b5-f377-4c92-85b3-8134b09cdd9a tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 200 len: 353 microversion: 2.1 time: 0.056045 Jul 20 09:41:32.253230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 331/677] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:41:32 2022] GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:32.318898 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:32.319460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:32.326713 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:32.327153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:32.327933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:32.328360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:32.330961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:32.467086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:32.476060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:32.477710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:32.478933 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4dcac26c-5b17-4747-871b-3acc2339f0b2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1742 microversion: 2.20 time: 0.164100 Jul 20 09:41:32.483580 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 347/678] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:32 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:33.261590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9f6d35a9-de23-4a9b-8398-11d6d85a850b tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f4496940>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:33.310496 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9f6d35a9-de23-4a9b-8398-11d6d85a850b tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 200 len: 354 microversion: 2.1 time: 0.053393 Jul 20 09:41:33.316872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 332/679] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:41:33 2022] GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:33.317304 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-504050771"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:33.318236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:33.323162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3eccc20f-4fe6-4ff1-bd8d-f114040c50f4 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f4360670>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:33.325296 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:33.325747 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:33.326541 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:33.326994 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:33.374154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3eccc20f-4fe6-4ff1-bd8d-f114040c50f4 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 200 len: 354 microversion: 2.1 time: 0.054714 Jul 20 09:41:33.374722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 333/680] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:41:33 2022] GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:33.390983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5697b245-79a1-4a02-a4bd-9bbefad766a3 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f479e280>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:33.464793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5697b245-79a1-4a02-a4bd-9bbefad766a3 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 202 len: 0 microversion: 2.1 time: 0.076966 Jul 20 09:41:33.465743 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 334/681] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:41:33 2022] DELETE /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:41:33.474283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a9fbc08d-61ed-4abc-ac7f-c2dc694d1db1 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f4496700>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:33.483960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.network.security_group_api [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Removing security group d5604d77-a207-4fb6-9670-407112042b50 from port 2c6b639d-4460-4929-a29a-c38cbf380511 Jul 20 09:41:33.532952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a9fbc08d-61ed-4abc-ac7f-c2dc694d1db1 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 200 len: 353 microversion: 2.1 time: 0.062911 Jul 20 09:41:33.537968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 335/682] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:41:33 2022] GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:41:33.538374 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:33.538964 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:33.546045 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:33.546481 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:33.547227 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:33.547674 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:33.709294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:33.720108 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:33.721702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:33.722957 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-249bb864-f0bb-4a53-a6e3-675bc93af97a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1742 microversion: 2.20 time: 0.188389 Jul 20 09:41:33.734653 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 336/683] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:33 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:33.866900 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6a98b02c-8103-4b97-9f75-cb8f0c9d9f6c tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action" status: 202 len: 0 microversion: 2.1 time: 0.552742 Jul 20 09:41:33.868114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 348/684] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:41:33 2022] POST /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:41:33.962882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-4e6f1a15-8c4d-4c72-8465-ba34407b5969 req-515e3580-6c7e-4a5a-adb6-825ce2d92c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:33.980831 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4e6f1a15-8c4d-4c72-8465-ba34407b5969 req-515e3580-6c7e-4a5a-adb6-825ce2d92c60 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:33.981614 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4e6f1a15-8c4d-4c72-8465-ba34407b5969 req-515e3580-6c7e-4a5a-adb6-825ce2d92c60 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:33.994352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-4e6f1a15-8c4d-4c72-8465-ba34407b5969 req-515e3580-6c7e-4a5a-adb6-825ce2d92c60 service nova] Creating event network-changed:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:41:34.000247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-4e6f1a15-8c4d-4c72-8465-ba34407b5969 req-515e3580-6c7e-4a5a-adb6-825ce2d92c60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124422 Jul 20 09:41:34.001176 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 337/685] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:34.547771 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0799f615-c563-4193-8c69-1b2b3830b487 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Calling method '.version_select at 0x7f81f4267940>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:34.589673 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-0799f615-c563-4193-8c69-1b2b3830b487 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] HTTP exception thrown: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0799f615-c563-4193-8c69-1b2b3830b487 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Request method failure captured: Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 HTTP/1.1 Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi183Lz9GMXpJUyySNuo_EUA3nucgMQSlIP2WeIS6k2HpJgDm6DpfHmXZ39DVXcUWwNHE7PqBjFcmh1EnNQhxI5ripO-ul7W_vBhxZZPjVdy_7zn1XNOhhQEZTE1vKaTnhlIWvQE7Dc4nFFs73GDv0L-rb4L6Xvi3n5htsekGDqWmB5OI Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 4620033402a34d98814dd490b3ec13dc Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesGetTestJSON-1710022102 Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:41:34.593729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4620033402a34d98814dd490b3ec13dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4620033402a34d98814dd490b3ec13dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4620033402a34d98814dd490b3ec13dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4620033402a34d98814dd490b3ec13dc"}]}] Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesGetTestJSON-1710022102 Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 4620033402a34d98814dd490b3ec13dc Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesGetTestJSON-1710022102 Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesGetTestJSON-1710022102-project Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: d3cead37bec04abb82151de765c60a9d Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesGetTestJSON-1710022102-project Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'cfa160e9-cc65-45c5-9755-99f846c8d502'} Jul 20 09:41:34.595432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. (HTTP 404) (Request-ID: req-a7e7fe78-110e-4217-bf9d-400b36e73baa) Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:34.596360 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:41:34.597719 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:41:34.599094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. Jul 20 09:41:34.600493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:41:34.602546 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0799f615-c563-4193-8c69-1b2b3830b487 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] Returning 404 to user: Volume cfa160e9-cc65-45c5-9755-99f846c8d502 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:34.604437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0799f615-c563-4193-8c69-1b2b3830b487 tempest-VolumesGetTestJSON-1710022102 tempest-VolumesGetTestJSON-1710022102-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502" status: 404 len: 109 microversion: 2.1 time: 0.062171 Jul 20 09:41:34.610263 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 349/686] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:41:34 2022] GET /compute/v2.1/os-volumes/cfa160e9-cc65-45c5-9755-99f846c8d502 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:41:34.746208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:34.747142 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:34.754465 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:34.755234 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:34.756313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:34.756842 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:34.968620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:34.983962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:34.985511 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:34.986691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1376d6b1-1e2d-423a-ae97-6b5f44466611 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.248469 Jul 20 09:41:34.990990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 338/687] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:34 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:35.181663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:35.182167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:35.191968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:35.192725 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:35.193860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:35.194526 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:35.290149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lazy-loading 'services' on Instance uuid 41ddf4cc-330e-4e95-9081-bf40e350914c {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:41:35.399602 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3dc41716-f48b-4e71-ab3a-eb73aed8a5f6 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments/4f6ade61-9170-4e49-8557-66cb974ffddf" status: 202 len: 0 microversion: 2.1 time: 0.221693 Jul 20 09:41:35.404709 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 350/688] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:41:35 2022] DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments/4f6ade61-9170-4e49-8557-66cb974ffddf => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:41:35.409719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:35.410854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:35.422645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:35.423360 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:35.425059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:35.426159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:35.450507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:35.487190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b4c87b8d-2095-4514-8a3b-f7bc9e76d6c8 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081579 Jul 20 09:41:35.488295 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 339/689] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:41:35 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:35.762652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-bf9e3e60-79cc-46ef-863a-89472b96fc2e req-b5482f94-1841-49f5-b9d5-d39f9583ff21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "name": "network-vif-plugged", "status": "completed", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:35.786040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bf9e3e60-79cc-46ef-863a-89472b96fc2e req-b5482f94-1841-49f5-b9d5-d39f9583ff21 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:35.786491 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bf9e3e60-79cc-46ef-863a-89472b96fc2e req-b5482f94-1841-49f5-b9d5-d39f9583ff21 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:35.798798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-bf9e3e60-79cc-46ef-863a-89472b96fc2e req-b5482f94-1841-49f5-b9d5-d39f9583ff21 service nova] Creating event network-vif-plugged:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:41:35.833396 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-bf9e3e60-79cc-46ef-863a-89472b96fc2e req-b5482f94-1841-49f5-b9d5-d39f9583ff21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072709 Jul 20 09:41:35.836363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 351/690] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:36.008157 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:36.008822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:36.018781 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-7992ebd5-5291-4151-a644-cea1772b4a94 req-da323504-4aaf-4553-8fa5-1e0e3e2d1200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:36.021986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.022392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.023173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.032565 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.041192 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-7992ebd5-5291-4151-a644-cea1772b4a94 req-da323504-4aaf-4553-8fa5-1e0e3e2d1200 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.042722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-7992ebd5-5291-4151-a644-cea1772b4a94 req-da323504-4aaf-4553-8fa5-1e0e3e2d1200 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.057575 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-7992ebd5-5291-4151-a644-cea1772b4a94 req-da323504-4aaf-4553-8fa5-1e0e3e2d1200 service nova] Creating event network-changed:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:41:36.066968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-7992ebd5-5291-4151-a644-cea1772b4a94 req-da323504-4aaf-4553-8fa5-1e0e3e2d1200 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054857 Jul 20 09:41:36.069456 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 352/691] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:41:36.373933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:36.387046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:36.389014 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:36.392236 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-446aef7f-f58e-4c74-a407-b40101dcfd09 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.388227 Jul 20 09:41:36.395989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 340/692] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:36 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:36.504670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:36.505698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:36.525008 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.525457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.526245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.526718 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.611864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4a0759ac-81c9-4904-af3a-f5499a242e1d tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116222 Jul 20 09:41:36.619653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 353/693] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:41:36 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:41:36.623555 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:36.624349 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:36.635043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.636379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.637779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:36.640416 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:36.782540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] HTTP exception thrown: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c is not attached to volume 4f6ade61-9170-4e49-8557-66cb974ffddf Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Request method failure captured: Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments/4f6ade61-9170-4e49-8557-66cb974ffddf HTTP/1.1 Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi181KOtCjJvAvzO4i3q1_qe44wUY1zBQKNOYknWaIm4Z-PMr0N3jIaCmeTM1WWuoaXwjE_KY8ne1HP0jQ3eK9sU1ebcCkU5ITL8ymIG2QBoBnBVOWBftNqGRMKBo5QN6B8g8J84f763p9co2M9DowTxLca9D2xxhmgvCAMY_YukckLZg Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 65ccb95f08764f99b5a5c1166c42410b Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:41:36.785715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65ccb95f08764f99b5a5c1166c42410b"}]}] Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 65ccb95f08764f99b5a5c1166c42410b Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-TestMinimumBasicScenario-250578081-project Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: e4f9820744874f9c979cb18cbf624fb4 Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-TestMinimumBasicScenario-250578081-project Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:41:36.787683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c is not attached to volume 4f6ade61-9170-4e49-8557-66cb974ffddf Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'server_id': '41ddf4cc-330e-4e95-9081-bf40e350914c', 'id': '4f6ade61-9170-4e49-8557-66cb974ffddf'} Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4f6ade61-9170-4e49-8557-66cb974ffddf. Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:36.788568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c is not attached to volume 4f6ade61-9170-4e49-8557-66cb974ffddf Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c is not attached to volume 4f6ade61-9170-4e49-8557-66cb974ffddf Jul 20 09:41:36.790039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:36.792401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Returning 404 to user: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c is not attached to volume 4f6ade61-9170-4e49-8557-66cb974ffddf {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:36.793443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f5b716b0-93ef-40fb-a032-9203605c8b30 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments/4f6ade61-9170-4e49-8557-66cb974ffddf" status: 404 len: 154 microversion: 2.1 time: 0.175191 Jul 20 09:41:36.794344 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 341/694] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:41:36 2022] DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c/os-volume_attachments/4f6ade61-9170-4e49-8557-66cb974ffddf => generated 154 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:41:37.414651 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:37.415191 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:37.422292 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:37.422723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:37.423721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:37.424365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:37.617563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:37.629802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:37.632026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:37.633743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-559211e7-d009-408b-a7d9-cee4ee07df87 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.223583 Jul 20 09:41:37.635732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 354/695] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:37 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:38.023000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:38.023580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:38.030901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.031513 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.032273 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.032693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.062894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:41:38.188869 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2873dd18-8ed8-4041-9f80-0c9fcd15de20 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 204 len: 0 microversion: 2.1 time: 0.169551 Jul 20 09:41:38.192443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 342/696] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:41:38 2022] DELETE /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:38.197540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:38.198299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:38.210808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.211256 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.212104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.212540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.429716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:38.448832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f6b11e7b-c577-416f-bda3-ff2de1c2a513 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1552 microversion: 2.1 time: 0.254490 Jul 20 09:41:38.450123 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 355/697] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:38 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1552 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:38.654268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:38.654861 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:38.660761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.661198 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.661939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:38.662615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:38.804881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:38.814437 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:38.816000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:38.817163 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d057f93d-a104-4749-b2ec-40012fec8544 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.167916 Jul 20 09:41:38.817725 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 343/698] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:38 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:39.467339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:39.469472 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:39.476024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:39.476474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:39.477335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:39.477724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:39.631012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:39.647831 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f4340b0d-89c8-4ac2-af01-497eede7be33 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1552 microversion: 2.1 time: 0.185451 Jul 20 09:41:39.649199 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 356/699] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:39 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:39.842970 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:39.843650 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:39.855430 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:39.855932 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:39.856700 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:39.857130 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:40.029931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:40.040063 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:40.042589 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:40.044569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-618d77a2-ce80-4808-b16a-5d1c122aed1b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.205903 Jul 20 09:41:40.045143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 344/700] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:39 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:40.676220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:40.677986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:40.685578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:40.686284 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:40.687233 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:40.687832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:40.785798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f9820744874f9c979cb18cbf624fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ccb95f08764f99b5a5c1166c42410b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:40.806268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e57e4038-ff7e-4999-aeb1-bea0e7e77ffa tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 200 len: 1510 microversion: 2.1 time: 0.140786 Jul 20 09:41:40.822950 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 357/701] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:40 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:41:41.007504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-462a486c-c847-431f-9a30-51c2fad8893e req-17f3f645-5620-4852-8168-680759a922ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41ddf4cc-330e-4e95-9081-bf40e350914c", "name": "network-vif-deleted", "tag": "2c6b639d-4460-4929-a29a-c38cbf380511"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:41.017469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-462a486c-c847-431f-9a30-51c2fad8893e req-17f3f645-5620-4852-8168-680759a922ef service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:41.018274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-462a486c-c847-431f-9a30-51c2fad8893e req-17f3f645-5620-4852-8168-680759a922ef service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:41.032594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-462a486c-c847-431f-9a30-51c2fad8893e req-17f3f645-5620-4852-8168-680759a922ef service nova] Creating event network-vif-deleted:2c6b639d-4460-4929-a29a-c38cbf380511 for instance 41ddf4cc-330e-4e95-9081-bf40e350914c on hv-cinder-82282 Jul 20 09:41:41.038109 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-462a486c-c847-431f-9a30-51c2fad8893e req-17f3f645-5620-4852-8168-680759a922ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196022 Jul 20 09:41:41.039258 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 345/702] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:41.062515 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:41.063168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:41.069547 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:41.069997 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:41.070814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:41.071247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:41.274428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:41.290259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:41.293679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:41.300449 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ddbdc237-cde6-4f54-8c32-259c62265af3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.241166 Jul 20 09:41:41.302048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 358/703] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:41 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:41.824711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:41.825829 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] [instance: 41ddf4cc-330e-4e95-9081-bf40e350914c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:41.833787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:41.834262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:41.835225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:41.835692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:41.850911 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] HTTP exception thrown: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Request method failure captured: Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c HTTP/1.1 Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi181KOtCjJvAvzO4i3q1_qe44wUY1zBQKNOYknWaIm4Z-PMr0N3jIaCmeTM1WWuoaXwjE_KY8ne1HP0jQ3eK9sU1ebcCkU5ITL8ymIG2QBoBnBVOWBftNqGRMKBo5QN6B8g8J84f763p9co2M9DowTxLca9D2xxhmgvCAMY_YukckLZg Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 65ccb95f08764f99b5a5c1166c42410b Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:41:41.852587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/65ccb95f08764f99b5a5c1166c42410b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/65ccb95f08764f99b5a5c1166c42410b"}]}] Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 65ccb95f08764f99b5a5c1166c42410b Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-TestMinimumBasicScenario-250578081 Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-TestMinimumBasicScenario-250578081-project Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: e4f9820744874f9c979cb18cbf624fb4 Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-TestMinimumBasicScenario-250578081-project Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. Jul 20 09:41:41.854229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '41ddf4cc-330e-4e95-9081-bf40e350914c'} Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:41:41.856326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. Jul 20 09:41:41.858237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:41:41.860581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Returning 404 to user: Instance 41ddf4cc-330e-4e95-9081-bf40e350914c could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:41:41.860581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-968a9f21-1b3a-4671-b181-8b5502af0f48 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c" status: 404 len: 111 microversion: 2.1 time: 0.033752 Jul 20 09:41:41.863351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ce8a95ac-a72c-437a-b26f-0ec146735c35 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] Calling method '.version_select at 0x7f81f42cc700>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:41.867033 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 346/704] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:41:41 2022] GET /compute/v2.1/servers/41ddf4cc-330e-4e95-9081-bf40e350914c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:41:41.887082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ce8a95ac-a72c-437a-b26f-0ec146735c35 tempest-TestMinimumBasicScenario-250578081 tempest-TestMinimumBasicScenario-250578081-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-601175781" status: 202 len: 0 microversion: 2.1 time: 0.027237 Jul 20 09:41:41.888278 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 359/705] 10.222.0.18 () {58 vars in 1268 bytes} [Wed Jul 20 09:41:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-601175781 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:41:42.321669 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:42.322276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:42.329772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:42.330446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:42.331417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:42.332009 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:42.535181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:42.545570 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:42.547215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:42.548699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-abd29bea-d5ab-478c-a74c-4036027aca75 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.231263 Jul 20 09:41:42.549797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 347/706] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:42 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:43.084763 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:43.085371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:43.094959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:43.095717 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:43.096666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:43.097251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:43.129316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1fdae219-41a2-4b1a-87a3-d3c29b15bb22 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/ips" status: 200 len: 144 microversion: 2.1 time: 0.052136 Jul 20 09:41:43.135472 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 360/707] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:41:43 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/ips => generated 144 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:43.567750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:43.569914 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:43.578238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:43.580171 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:43.581380 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:43.582297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:43.790986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:43.801292 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:43.802796 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:43.803978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f0bf4ab6-ad52-4321-8cc7-a3f12d758aab tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.240353 Jul 20 09:41:43.805013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 348/708] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:43 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:44.637873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2009e6da-ab63-41a2-9a47-3a862a45ec67"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:44.638836 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:44.642236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:44.658948 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:44.661689 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:44.664412 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:44.664668 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:44.823011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:44.824783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:44.833412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:44.834475 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:44.835438 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:44.836050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:45.048750 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-40595b94-bf22-41ab-adb2-1ad48478bc8d tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418969 Jul 20 09:41:45.050834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 361/709] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:41:44 2022] POST /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:41:45.191965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:45.202681 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:45.205209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:45.207416 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3a63adfe-8ddf-4b0f-99da-ba15a282e9ad tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.388474 Jul 20 09:41:45.219355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 349/710] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:44 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:46.228212 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:46.229606 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:46.245374 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:46.245922 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:46.246692 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:46.247332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:46.402018 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:46.410238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:46.411896 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:46.413334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3c0f9b3c-bafd-4f5d-91b6-d46a054ed029 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1737 microversion: 2.20 time: 0.190401 Jul 20 09:41:46.414239 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 362/711] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:46 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:47.449193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:47.449804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:47.458216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:47.458892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:47.460171 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:47.460770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:47.781177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:47.789498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:47.791011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:47.792639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7fcc7d9d-7ccb-4450-9f14-cc85fb139184 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1719 microversion: 2.20 time: 0.363243 Jul 20 09:41:47.793214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 350/712] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:47 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1719 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:48.812221 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:48.812945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:48.819904 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:48.820402 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:48.821175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:48.821615 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:49.056696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:49.068722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:49.071579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:49.073563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-62e1d598-b4c7-468d-bc24-b6209e2d8bd2 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1719 microversion: 2.20 time: 0.265171 Jul 20 09:41:49.074478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 363/713] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:48 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1719 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:49.688459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-7454f121-4a08-4c99-b120-2803589ce9e1 req-05afd95c-02d5-4e86-94d7-5285861ca5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "name": "network-vif-unplugged", "status": "completed", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:49.693410 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:49.702253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7454f121-4a08-4c99-b120-2803589ce9e1 req-05afd95c-02d5-4e86-94d7-5285861ca5d1 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:49.702694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7454f121-4a08-4c99-b120-2803589ce9e1 req-05afd95c-02d5-4e86-94d7-5285861ca5d1 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:49.721597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-7454f121-4a08-4c99-b120-2803589ce9e1 req-05afd95c-02d5-4e86-94d7-5285861ca5d1 service nova] Creating event network-vif-unplugged:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:41:49.727242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-7454f121-4a08-4c99-b120-2803589ce9e1 req-05afd95c-02d5-4e86-94d7-5285861ca5d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.246578 Jul 20 09:41:49.728850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 351/714] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:41:50.101916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:50.104779 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:50.113453 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:50.113724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:50.114499 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:50.114924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:50.328656 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:50.337766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:50.339335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:50.340810 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-57adfec9-3a2b-49a8-a8c3-c4784fd43948 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1662 microversion: 2.20 time: 0.248484 Jul 20 09:41:50.341371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 364/715] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:50 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1662 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:50.364932 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a5d9b85-6188-49a4-aed3-ac9727184836"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:50.366086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:50.377824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:50.378719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:50.379682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:50.380262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:50.810965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-aa811c6c-d51d-40eb-90ac-ffb82064031a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454338 Jul 20 09:41:50.829363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 352/716] 10.222.0.18 () {62 vars in 1363 bytes} [Wed Jul 20 09:41:50 2022] POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments => generated 188 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:41:50.989118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:50.989829 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:50.997948 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:50.998990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.000102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.000958 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.168514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:51.468991 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a87308f3-70c9-478e-bb8a-b97c326d0097 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments/9a5d9b85-6188-49a4-aed3-ac9727184836" status: 202 len: 0 microversion: 2.20 time: 0.483304 Jul 20 09:41:51.470897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 365/717] 10.222.0.18 () {60 vars in 1456 bytes} [Wed Jul 20 09:41:50 2022] DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments/9a5d9b85-6188-49a4-aed3-ac9727184836 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:51.598323 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:51.599749 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:51.609854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.610766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.611907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.612483 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.630403 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:41:51.777092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:51.779200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:51.791029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.792545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.793190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.793627 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.849633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e3a92b08-0dbf-4230-9606-ac526abb6bf2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079285 Jul 20 09:41:51.855251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 366/718] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:41:51 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:51.860803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:51.861296 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:51.867367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.867827 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.868657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.869076 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.901826 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8b313d42-ad62-40ee-a2a5-9fccfbc25b33 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67" status: 200 len: 194 microversion: 2.1 time: 0.044359 Jul 20 09:41:51.902450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 367/719] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jul 20 09:41:51 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:41:51.922792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9e4a36e1-4c87-440c-951e-0e37e4493c88 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/action" status: 202 len: 0 microversion: 2.20 time: 0.328243 Jul 20 09:41:51.924814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 353/720] 10.222.0.18 () {62 vars in 1318 bytes} [Wed Jul 20 09:41:51 2022] POST /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:41:51.933237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:51.933869 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:51.945944 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.948976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:51.952585 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:51.953346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:52.306089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:52.318105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:52.321685 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:52.324064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-da8b826e-71bc-48d4-b3e0-09f31979624f tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1670 microversion: 2.20 time: 0.394911 Jul 20 09:41:52.331794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 368/721] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:51 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1670 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:41:53.297006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6aea7f-1e43-4c50-9803-009209c6484e"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:41:53.298127 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:53.310339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:53.310786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:53.317028 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:53.317710 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:53.343487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:53.344831 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:53.372590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:53.373155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:53.374025 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:53.374396 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:53.549356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:53.559963 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:53.562183 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:53.564111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3ae7eb5c-671e-4cf3-9dd9-4058af2901d3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.225487 Jul 20 09:41:53.564956 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 369/722] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:53 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:53.692651 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1e6dcce8-b797-48c7-ab3f-6503feb9eccb tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "POST /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399425 Jul 20 09:41:53.694407 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 354/723] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:41:53 2022] POST /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:41:54.585267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:54.586064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:54.595214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:54.596191 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:54.597564 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:54.597995 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:54.746270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:54.754708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:54.756626 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:54.757927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e4354be1-0517-422a-8af8-87978a6fe5d0 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.178668 Jul 20 09:41:54.758592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 370/724] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:54 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:55.777908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:55.779265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:55.786332 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:55.786771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:55.787819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:55.788243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:55.951654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:55.963989 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:55.966381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:55.968073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-daebb1b8-fd0d-4ba8-9d80-8cfdeb256aeb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.194288 Jul 20 09:41:55.969278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 355/725] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:55 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:56.987383 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:56.988864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:56.998666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:56.999361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:57.000307 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:57.000927 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:57.331631 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:57.347743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:57.349327 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:57.355884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a1f95ff4-8f74-4d59-bf3d-dd2004d2c465 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.372808 Jul 20 09:41:57.358019 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 371/726] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:56 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:58.382224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:58.383925 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:58.409542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:58.410256 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:58.412541 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:58.418337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:58.584062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:58.593026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:58.594521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:58.595711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1de49131-9f48-49a8-8e09-8d88e19baf0c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.224054 Jul 20 09:41:58.596264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 356/727] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:58 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:41:59.621993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:41:59.622774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:41:59.647522 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:59.649658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:59.650550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:41:59.651634 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:41:59.902637 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:59.911470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:59.913245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:41:59.925025 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6a480ed6-f33d-4fb4-bee7-a9f5db24391a tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.311703 Jul 20 09:41:59.936980 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 372/728] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:41:59 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:42:00.952356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:00.952977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:00.975087 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:00.975729 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:00.976353 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:00.976761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:01.500436 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:01.522810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:01.525383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:01.532357 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c08ef941-c3d4-49a0-a62f-bdb8a598aefb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.592253 Jul 20 09:42:01.550892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 357/729] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:00 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:02.554085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:02.555525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:02.573723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:02.576303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:02.578413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:02.580115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:02.946811 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:02.965849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:02.971002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:02.982473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bac114e1-8701-4c28-8792-ddc343650103 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.431906 Jul 20 09:42:02.983355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 373/730] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:02 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:42:04.001664 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:04.002274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:04.026012 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:04.026466 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:04.027251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:04.027719 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:04.303703 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:04.311901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:04.313492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:04.328646 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4cb00f04-e96d-4aa5-9394-45cb9be95267 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.330724 Jul 20 09:42:04.336097 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 358/731] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:03 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:05.355022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:05.355572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:05.362080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:05.362744 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:05.363541 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:05.364942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:05.598390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:05.608618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:05.610153 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:05.611394 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e1e351be-89d6-4552-8485-d4cca45e5bcf tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.261226 Jul 20 09:42:05.611976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 374/732] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:05 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:42:05.894850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:05.896543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:05.904315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:05.905055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:05.906011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:05.906629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:05.945810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e4adfa1b-d926-4b27-b39b-59c382c5b4f2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054813 Jul 20 09:42:05.946865 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 359/733] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:42:05 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:06.098214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:06.099006 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:06.105772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.110463 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.111663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.112057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.156322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9068323e-ff8c-40ee-a4a1-7888103453f6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67" status: 200 len: 194 microversion: 2.1 time: 0.062513 Jul 20 09:42:06.156950 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 375/734] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jul 20 09:42:06 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:06.168178 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:06.168826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:06.175594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.176542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.177306 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.177903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.273792 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lazy-loading 'services' on Instance uuid dcc4383c-74cf-41bd-a13b-645e0dec5e66 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:42:06.356390 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5b0caf2c-3299-478c-b05b-2fc92d446513 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67" status: 202 len: 0 microversion: 2.1 time: 0.193562 Jul 20 09:42:06.357129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 360/735] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:42:06 2022] DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/2009e6da-ab63-41a2-9a47-3a862a45ec67 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:42:06.464731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-635e1303-dd16-4061-a960-950497358cfe tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Action: 'create', calling method: .version_select at 0x7f81f41e89d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1330071063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpch4v/V2sP8b031aE+ZWx25FYABRxnoIxGBIKh29YewDl9f/gWIQI/BwodNqnaPtt/XP5sWhocQ//7zFjEEoIFy2L9c/wkTa5BlXBrEckoJqqM7JMaRbm6WpDZuBDU6A=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:06.491659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-635e1303-dd16-4061-a960-950497358cfe tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Getting quotas for project ee1753001c624ae3941cfc51b3d9d6ef. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:42:06.491659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-635e1303-dd16-4061-a960-950497358cfe tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Getting quotas for user 0821d7c651dc4571834b8f3c40b225a9 and project ee1753001c624ae3941cfc51b3d9d6ef. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:42:06.520815 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-635e1303-dd16-4061-a960-950497358cfe tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.257989 Jul 20 09:42:06.521428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 376/736] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:42:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:06.633584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:06.634840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:06.649296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.649978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.655111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:06.655758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:06.899843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:06.910898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:06.912999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:06.914328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7754a1d1-9869-4a05-a411-30a3fa9a9e38 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.287740 Jul 20 09:42:06.927095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 361/737] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:06 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:07.934460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:07.943458 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:07.951428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:07.951767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:07.952545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:07.952980 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:08.159553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:08.170255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:08.176169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:08.178504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-44e711d0-9902-4172-84ed-10df0fdb4ad7 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.248657 Jul 20 09:42:08.179064 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 377/738] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:07 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:09.209774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:09.210437 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:09.235576 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:09.252707 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:09.254285 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:09.262081 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:09.594803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:09.604603 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:09.606277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:09.607688 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e1287eb5-f6a1-49d8-8c95-3eadab19c82c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.408326 Jul 20 09:42:09.608350 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 362/739] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:09 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:10.646121 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:10.647239 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:10.659101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:10.660080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:10.661247 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:10.661991 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:10.857735 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:10.865980 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:10.867521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:10.868688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9f63d6dc-90e0-49c9-92b0-57797c3f1510 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.242718 Jul 20 09:42:10.869255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 378/740] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:10 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:11.846875 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:11.847545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:11.855217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.856593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:11.857365 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.857800 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:11.898436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:11.899897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:11.906259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.906935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:11.907920 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.911359 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:11.911634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f537eea4-be41-4ed8-8dc3-510acc70705f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/9b6aea7f-1e43-4c50-9803-009209c6484e" status: 200 len: 194 microversion: 2.1 time: 0.066392 Jul 20 09:42:11.911634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 363/741] 10.222.0.18 () {58 vars in 1412 bytes} [Wed Jul 20 09:42:11 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/9b6aea7f-1e43-4c50-9803-009209c6484e => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:11.921189 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:11.921666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:11.928251 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.928864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:11.929685 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:11.930311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:12.016191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lazy-loading 'services' on Instance uuid dcc4383c-74cf-41bd-a13b-645e0dec5e66 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:42:12.053125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:12.062175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:12.063930 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:12.065116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7e12cf29-a863-463a-88ac-eb9cf082115e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.171933 Jul 20 09:42:12.065672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 379/742] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:11 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:12.101686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-40f17fb9-fc56-4cef-aac6-1739b0bcace2 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/9b6aea7f-1e43-4c50-9803-009209c6484e" status: 202 len: 0 microversion: 2.1 time: 0.184795 Jul 20 09:42:12.102284 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 364/743] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:42:11 2022] DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments/9b6aea7f-1e43-4c50-9803-009209c6484e => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:42:13.089521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:13.090131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:13.096657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.097109 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.097908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.098344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.247523 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:13.251257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:13.256315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:13.257851 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:13.259011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-df670a06-e231-4918-b8c4-3f5aded58b6b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.174116 Jul 20 09:42:13.259609 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 380/744] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:13 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:13.299440 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:13.300686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:13.309498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.310296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.311765 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.312210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.343111 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4135f4ab-9765-4117-a1c1-4b8cd8b8c223 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048553 Jul 20 09:42:13.343706 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 365/745] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:42:13 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:42:13.459669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:13.460663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:13.468412 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.468857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.469618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.470050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.500699 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c17ce1e2-f8a3-41d6-a3d9-e4d8c7fca939 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044921 Jul 20 09:42:13.501171 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 381/746] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:42:13 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:42:13.568866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:13.569477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:13.576038 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.576582 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.577328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.577751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.592751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:13.605475 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:42:13.686636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-541aae3c-8153-4358-9525-2023ca0b3d01 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 204 len: 0 microversion: 2.1 time: 0.121507 Jul 20 09:42:13.687249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 366/747] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:42:13 2022] DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:42:13.696356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:13.696965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:13.703671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.704168 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.705122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:13.705551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:13.854125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:13.862370 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1b39b08a-3f5b-4687-ba2e-9498d35e17a5 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1672 microversion: 2.1 time: 0.170582 Jul 20 09:42:13.863260 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 382/748] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:13 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:14.280589 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:14.281360 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:14.287697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:14.288214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:14.288977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:14.289396 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:14.440633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:14.456534 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:14.458046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:14.459222 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-20617aec-55c4-424f-8cb3-9e3542507c7b tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.184313 Jul 20 09:42:14.459978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 367/749] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:14 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:14.810657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-ee196b41-8b56-48e1-9043-4a98fcb1695d req-242495e2-7f13-4d60-b3f8-622801441865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "name": "network-vif-plugged", "status": "completed", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:14.814448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:14.822988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-ee196b41-8b56-48e1-9043-4a98fcb1695d req-242495e2-7f13-4d60-b3f8-622801441865 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:14.823681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-ee196b41-8b56-48e1-9043-4a98fcb1695d req-242495e2-7f13-4d60-b3f8-622801441865 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:14.837330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-ee196b41-8b56-48e1-9043-4a98fcb1695d req-242495e2-7f13-4d60-b3f8-622801441865 service nova] Creating event network-vif-plugged:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:42:14.843323 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-ee196b41-8b56-48e1-9043-4a98fcb1695d req-242495e2-7f13-4d60-b3f8-622801441865 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037317 Jul 20 09:42:14.843932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 383/750] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:42:14.885755 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:14.887757 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:14.897497 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:14.899098 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:14.900084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:14.903757 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:15.061311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:15.069370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2c127293-0df0-4da4-94f9-56e0cf06c9b3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1672 microversion: 2.1 time: 0.190913 Jul 20 09:42:15.069856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 368/751] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:14 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:15.481241 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:15.481962 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:15.488938 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:15.489380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:15.490135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:15.490565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:15.644184 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:15.653881 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:15.655543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:15.656808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d20c0d7a-a0bd-49f1-8a01-9f7661e0eb9e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.180372 Jul 20 09:42:15.657461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 384/752] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:15 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:16.089528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:16.089954 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:16.096810 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:16.097257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:16.098021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:16.098451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:16.352859 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:16.362536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f0aa8a46-ff05-43bb-a92b-e1d700e924b1 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1672 microversion: 2.1 time: 0.277568 Jul 20 09:42:16.363225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 369/753] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:16 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:16.676173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:16.676896 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:16.679207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=4 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:16.685565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:16.686097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:16.686849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:16.687273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:16.814085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-b9b1080b-ff78-4eff-b559-75d698d60069 req-a451b05c-b137-416c-b3ab-8dd7abf406b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc4383c-74cf-41bd-a13b-645e0dec5e66", "name": "network-vif-deleted", "tag": "87539666-3759-4a90-a2d8-d12fe5a15433"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:16.825180 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b9b1080b-ff78-4eff-b559-75d698d60069 req-a451b05c-b137-416c-b3ab-8dd7abf406b8 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:16.825616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b9b1080b-ff78-4eff-b559-75d698d60069 req-a451b05c-b137-416c-b3ab-8dd7abf406b8 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:16.838571 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-b9b1080b-ff78-4eff-b559-75d698d60069 req-a451b05c-b137-416c-b3ab-8dd7abf406b8 service nova] Creating event network-vif-deleted:87539666-3759-4a90-a2d8-d12fe5a15433 for instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 on hv-cinder-82282 Jul 20 09:42:16.840427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:16.847334 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-b9b1080b-ff78-4eff-b559-75d698d60069 req-a451b05c-b137-416c-b3ab-8dd7abf406b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037738 Jul 20 09:42:16.848365 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 370/754] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:42:16.857821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:16.859536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:16.860764 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-38871f1f-9560-48b1-b40b-0b8558663b8e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.188534 Jul 20 09:42:16.861320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 385/755] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:16 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:17.380749 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:17.382099 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:17.388634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:17.389334 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:17.390101 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:17.390530 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:17.425202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:17.425979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:17.426686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lazy-loading 'fault' on Instance uuid dcc4383c-74cf-41bd-a13b-645e0dec5e66 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:42:17.485655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee885a29e6fa4b1980d7ae1d03b2b476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e068f9b959004be4ad9c778d9010561a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:17.493523 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1a6afe7e-6da5-48bc-8d75-7259b3a2ebf6 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 200 len: 1327 microversion: 2.1 time: 0.117317 Jul 20 09:42:17.494653 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 371/756] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:17 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:17.879974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:17.880669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:17.889039 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:17.889482 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:17.890252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:17.890679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:18.085903 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:18.094698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:18.098166 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:18.099565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5a762e54-5fa3-4964-87e1-3565353b776e tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1728 microversion: 2.20 time: 0.223675 Jul 20 09:42:18.110489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 386/757] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:17 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:18.512290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:18.512995 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:18.519568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:18.520010 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:18.520766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:18.521194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:18.535643 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 HTTP/1.1 Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:18.537278 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:18.539215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'dcc4383c-74cf-41bd-a13b-645e0dec5e66'} Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:18.540282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:18.542288 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:18.543624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:18.543624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6a1817cc-884b-4c16-bc07-e1860ad19c71 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 404 len: 111 microversion: 2.1 time: 0.031604 Jul 20 09:42:18.543624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 372/758] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:18 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:18.550195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-58f3b16c-e59d-480a-a728-46fcf2d994b4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '.version_select at 0x7f81f42033a0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:18.567196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-58f3b16c-e59d-480a-a728-46fcf2d994b4 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-164482320" status: 202 len: 0 microversion: 2.1 time: 0.021375 Jul 20 09:42:18.567806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 387/759] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jul 20 09:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-164482320 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:42:19.125965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:19.127125 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:19.133262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:19.133807 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:19.134642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:19.135134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:19.303477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:19.308855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:19.310500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:19.311746 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a783e533-6125-4a81-8521-9ec4c141b981 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1715 microversion: 2.20 time: 0.197404 Jul 20 09:42:19.312483 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 373/760] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:19 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1715 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:21.462210 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:21.463433 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:21.469389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:21.470050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:21.470579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:21.471011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:21.485417 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 HTTP/1.1 Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:42:21.487074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.488745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'dcc4383c-74cf-41bd-a13b-645e0dec5e66'} Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:21.489569 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.490988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.492391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:21.492391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9343a3f9-3240-4346-a0bb-f1008ad828d3 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 404 len: 111 microversion: 2.1 time: 0.030679 Jul 20 09:42:21.492391 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 388/761] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:42:21 2022] DELETE /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:21.497540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:21.498219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: dcc4383c-74cf-41bd-a13b-645e0dec5e66] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:21.500894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:21.506262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:21.506705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:21.507544 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:21.507976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:21.521918 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 HTTP/1.1 Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:21.523467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.524953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'dcc4383c-74cf-41bd-a13b-645e0dec5e66'} Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:21.526277 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. Jul 20 09:42:21.527753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:21.528959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance dcc4383c-74cf-41bd-a13b-645e0dec5e66 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:21.528959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bf5d89cc-1a41-4469-b4f5-de2f8d552f5f tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66" status: 404 len: 111 microversion: 2.1 time: 0.031387 Jul 20 09:42:21.528959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 374/762] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:21 2022] GET /compute/v2.1/servers/dcc4383c-74cf-41bd-a13b-645e0dec5e66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:22.658701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:22.659969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:22.668367 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:22.668814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:22.669581 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:22.670012 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:22.686566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 HTTP/1.1 Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:42:22.688269 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.691003 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '09550419-8417-4448-af4b-10d9534548a4'} Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:22.692658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.695613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.698388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:22.698388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-854ae9ee-054b-46c1-b274-2e9b88114968 tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 404 len: 111 microversion: 2.1 time: 0.034771 Jul 20 09:42:22.698388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 389/763] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:42:22 2022] DELETE /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:22.699033 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:22.699033 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] [instance: 09550419-8417-4448-af4b-10d9534548a4] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:22.708152 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:22.708848 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:22.709629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:22.710062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:22.724474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] HTTP exception thrown: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Request method failure captured: Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 HTTP/1.1 Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18xzSdppulO_Q7lby_WRYEa6BceU05IakvpRYPzZtpD8wIsd89cAF_2wBKWeZZmE7FNnt03MBK1TUMYAyEsZvL6gL7nlatphMUpV7CDlS-_H0-oA8rRaousnkRAv9u2LWoFy0HHE9MwHP-MJUgQCL6dAveURvdwLHH_xTxb5kiq9JRI Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:22.726003 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e068f9b959004be4ad9c778d9010561a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e068f9b959004be4ad9c778d9010561a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e068f9b959004be4ad9c778d9010561a"}]}] Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: e068f9b959004be4ad9c778d9010561a Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeTestJSON-323046384 Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ee885a29e6fa4b1980d7ae1d03b2b476 Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeTestJSON-323046384-project Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.727545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '09550419-8417-4448-af4b-10d9534548a4'} Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:22.732478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. Jul 20 09:42:22.734621 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:22.736336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] Returning 404 to user: Instance 09550419-8417-4448-af4b-10d9534548a4 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:22.736336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-20a08d23-b32f-4605-b1a3-11cc960fd2df tempest-AttachVolumeTestJSON-323046384 tempest-AttachVolumeTestJSON-323046384-project] 10.222.0.18 "GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4" status: 404 len: 111 microversion: 2.1 time: 0.033196 Jul 20 09:42:22.736336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 375/764] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:22 2022] GET /compute/v2.1/servers/09550419-8417-4448-af4b-10d9534548a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:25.537227 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1097466403", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1330071063", "security_groups": [{"name": "tempest-secgroup-smoke-2047505651"}], "networks": [{"uuid": "c1011f17-baa3-428f-b14e-017bea4212af"}], "block_device_mapping_v2": [{"uuid": "49d79f20-735d-4b38-a927-291d5420be74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:25.766435 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] validate_networks() for [('c1011f17-baa3-428f-b14e-017bea4212af', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:42:26.454448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:42:26.454899 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:42:26.458112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:42:26.458112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:42:26.458112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:42:26.474457 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:26.474909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:26.475928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:26.476357 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:26.496250 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Getting quotas for project ee1753001c624ae3941cfc51b3d9d6ef. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:42:26.505136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Getting quotas for user 0821d7c651dc4571834b8f3c40b225a9 and project ee1753001c624ae3941cfc51b3d9d6ef. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:42:26.578177 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:42:26.580471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49d79f20-735d-4b38-a927-291d5420be74',volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:42:26.762506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-970260bb-cab5-47eb-8fb5-4b3736de9de4 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.229350 Jul 20 09:42:26.763696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 390/765] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:42:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:42:26.776553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b75f2a80-f197-4434-abcb-5c4d348ef06d tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:26.777283 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b75f2a80-f197-4434-abcb-5c4d348ef06d tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:26.849897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b75f2a80-f197-4434-abcb-5c4d348ef06d tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:26.857616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b75f2a80-f197-4434-abcb-5c4d348ef06d tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1089 microversion: 2.1 time: 0.086889 Jul 20 09:42:26.860232 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 376/766] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:26 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:27.878614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:27.879225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:27.887350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:27.887802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:27.888636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:27.888971 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:27.958336 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:27.966970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-af813f2f-3bb4-4620-a5e0-a125329edad7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1205 microversion: 2.1 time: 0.093443 Jul 20 09:42:27.968731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 391/767] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:27 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:28.093334 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-af871eb2-c8f9-4df3-b331-54d46cdd137c tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Action: 'create', calling method: .version_select at 0x7f81f434aaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1860671815"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:28.180891 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1966945063", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "networks": [{"uuid": "678df20b-79c7-46fd-b30a-63d1f65355a4"}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:28.244749 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] validate_networks() for [('678df20b-79c7-46fd-b30a-63d1f65355a4', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:42:28.492172 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-af871eb2-c8f9-4df3-b331-54d46cdd137c tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.574490 Jul 20 09:42:28.493100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 377/768] 10.222.0.18 () {60 vars in 1154 bytes} [Wed Jul 20 09:42:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 576 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 09:42:28.504089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-545e4c22-f886-4340-bc20-b2fff38c3cda tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f490a430>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:28.570873 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-545e4c22-f886-4340-bc20-b2fff38c3cda tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 200 len: 345 microversion: 2.1 time: 0.070538 Jul 20 09:42:28.577026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 378/769] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:42:28 2022] GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:42:28.708511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:42:28.709245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:42:28.709937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:42:28.710843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:42:28.711447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:42:28.723834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:28.724788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:28.725663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:28.726594 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:28.744496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Getting quotas for project 4f8dfa60d69d45c29013dbbe6c1dd226. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:42:28.749053 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Getting quotas for user 354e3e9955a74c1a86b7e4e6c9bbd512 and project 4f8dfa60d69d45c29013dbbe6c1dd226. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:42:28.761471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:42:28.765372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:42:28.822696 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-59d4ffd7-1029-466c-90ee-b3acc69107a4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644225 Jul 20 09:42:28.823986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 392/770] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:42:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 09:42:28.834508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8557acd3-2a2c-4e32-9a15-1522ecf84a08 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:28.835387 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8557acd3-2a2c-4e32-9a15-1522ecf84a08 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:28.954879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8557acd3-2a2c-4e32-9a15-1522ecf84a08 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:28.968545 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8557acd3-2a2c-4e32-9a15-1522ecf84a08 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1214 microversion: 2.1 time: 0.138216 Jul 20 09:42:28.969895 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 379/771] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:28 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:28.988953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:28.989588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:28.998533 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:28.999144 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:28.999959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:29.000395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:29.219240 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:29.231633 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-05118636-9923-43f7-9dcc-c5c7a10fa466 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.249861 Jul 20 09:42:29.235686 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 393/772] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:28 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:29.456880 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-adbedc2f-0ceb-4cba-9415-5b2c1eccad17 req-d846c84d-6588-40e8-92e5-51b6eff4baec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:29.471978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-adbedc2f-0ceb-4cba-9415-5b2c1eccad17 req-d846c84d-6588-40e8-92e5-51b6eff4baec service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:29.472840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-adbedc2f-0ceb-4cba-9415-5b2c1eccad17 req-d846c84d-6588-40e8-92e5-51b6eff4baec service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:29.486174 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-adbedc2f-0ceb-4cba-9415-5b2c1eccad17 req-d846c84d-6588-40e8-92e5-51b6eff4baec service nova] Creating event network-changed:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:42:29.492778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-adbedc2f-0ceb-4cba-9415-5b2c1eccad17 req-d846c84d-6588-40e8-92e5-51b6eff4baec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040083 Jul 20 09:42:29.493604 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 380/773] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:29.584590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-093e4235-22bb-491c-9f46-744a10c5655a tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f41f19d0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:29.637312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-093e4235-22bb-491c-9f46-744a10c5655a tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 200 len: 346 microversion: 2.1 time: 0.056831 Jul 20 09:42:29.637882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 394/774] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:42:29 2022] GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:29.649551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-222051bb-36ec-4f5a-ab1b-332f9c907698 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Action: 'create', calling method: .version_select at 0x7f81f438ec10>, body: {"snapshot": {"volume_id": "14d1f273-76b7-41cb-b115-5cce9131f72a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1352178325"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:29.793652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-222051bb-36ec-4f5a-ab1b-332f9c907698 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.148407 Jul 20 09:42:29.794243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 381/775] 10.222.0.18 () {60 vars in 1161 bytes} [Wed Jul 20 09:42:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:42:29.804553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b613a99f-19ff-42a6-ace2-70a71615b7f0 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f4245040>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:29.848876 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b613a99f-19ff-42a6-ace2-70a71615b7f0 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 287 microversion: 2.1 time: 0.047956 Jul 20 09:42:29.849660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 395/776] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:29 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:29.860704 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-412f9e3b-e1b8-4875-9751-5aa07fed61d6 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f6cbd700>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:29.891932 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-412f9e3b-e1b8-4875-9751-5aa07fed61d6 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035219 Jul 20 09:42:29.892660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 382/777] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jul 20 09:42:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:29.903654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b52e5a2e-070d-40b5-83e4-1a3019aca9b1 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f42a9280>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:29.936289 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b52e5a2e-070d-40b5-83e4-1a3019aca9b1 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 287 microversion: 2.1 time: 0.037097 Jul 20 09:42:29.937005 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 396/778] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:29 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:29.985985 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:29.986842 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:29.994916 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:29.995509 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:29.996348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:29.996845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:30.108243 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:30.115608 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-01bb2422-0545-4665-8ebc-3e8a769b30a8 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1284 microversion: 2.1 time: 0.133405 Jul 20 09:42:30.116170 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 383/779] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:29 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:30.248885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:30.249491 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:30.255459 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:30.255898 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:30.256643 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:30.257075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:30.395433 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:30.403538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2fc686e2-4140-4bb9-b8a0-f34c000ce4ea tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.159433 Jul 20 09:42:30.404098 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 397/780] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:30 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:30.948691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d0463e7e-c849-49d5-9959-6ba481f43f0f tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f490a430>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:30.979022 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d0463e7e-c849-49d5-9959-6ba481f43f0f tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 287 microversion: 2.1 time: 0.034615 Jul 20 09:42:30.979610 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 384/781] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:30 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:31.132574 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:31.133214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:31.139798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:31.140244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:31.140997 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:31.141429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:31.202864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:31.210217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b5ab1353-94b5-41f7-9bb8-dc809d8eff67 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1272 microversion: 2.1 time: 0.081535 Jul 20 09:42:31.210780 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 398/782] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:31 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:31.420582 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:31.421181 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:31.427135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:31.427623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:31.428372 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:31.428806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:31.563552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:31.570894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2cd0b68a-0a41-4b54-9ab9-de470aa8c6c1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.154606 Jul 20 09:42:31.571550 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 385/783] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:31 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:31.990024 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-835b85f7-9904-46c2-a4ad-66cf89193525 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f4203ca0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:32.019758 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-835b85f7-9904-46c2-a4ad-66cf89193525 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 287 microversion: 2.1 time: 0.033540 Jul 20 09:42:32.020316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 399/784] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:31 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:32.227311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:32.227955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:32.234540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:32.234978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:32.235755 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:32.236184 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:32.296645 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:32.304992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d5d4ac6c-d5eb-4409-bd92-cf122884405a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1272 microversion: 2.1 time: 0.081624 Jul 20 09:42:32.305563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 386/785] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:32 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:32.588778 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:32.589397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:32.596238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:32.596686 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:32.597475 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:32.597913 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:32.732338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:32.739903 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-29e970a1-d533-4c45-8004-c6b04abdb979 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.155610 Jul 20 09:42:32.740649 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 400/786] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:32 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:33.032093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8963b8b2-e6cd-49e4-a8db-448300b69d62 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f4387b80>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:33.062684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8963b8b2-e6cd-49e4-a8db-448300b69d62 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 288 microversion: 2.1 time: 0.034452 Jul 20 09:42:33.063351 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 387/787] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:33 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:33.073949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4748d58a-4648-45b2-94aa-6a8820a3feed tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f41f19d0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:33.132844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4748d58a-4648-45b2-94aa-6a8820a3feed tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 202 len: 0 microversion: 2.1 time: 0.063300 Jul 20 09:42:33.133417 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 401/788] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jul 20 09:42:33 2022] DELETE /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:42:33.142321 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1d88766d-36ec-464a-a85d-60aff54daabd tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f434a820>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:33.173487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1d88766d-36ec-464a-a85d-60aff54daabd tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 200 len: 287 microversion: 2.1 time: 0.034856 Jul 20 09:42:33.174054 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 388/789] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:33 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:33.322081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:33.323075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:33.329677 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:33.330259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:33.331035 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:33.331572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:33.623547 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:33.631125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a7d623cc-6367-4e35-81e2-347f893b4566 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.312978 Jul 20 09:42:33.631935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 402/790] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:33 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:33.757191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:33.757910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:33.765019 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:33.765530 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:33.766289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:33.766713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:34.018443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:34.026009 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-26938964-cca2-4143-90f5-8529a9145ef7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.272653 Jul 20 09:42:34.026589 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 389/791] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:33 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:34.185841 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-211f208d-1fef-4635-92d7-3fdd2f6b1f14 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f41f1160>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:34.211785 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-211f208d-1fef-4635-92d7-3fdd2f6b1f14 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] HTTP exception thrown: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-211f208d-1fef-4635-92d7-3fdd2f6b1f14 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Request method failure captured: Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 HTTP/1.1 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi184DbcpJNgaCxQqn8oO-bR_5aW58iyI9sncJgVo20eb3jJOWT4SQDCIhbqO43v-yP8CgNh3yhvVE5222dm6d49eYFv0dH9J7YTLly15pR0V8xrt-YGEKm5A5BZJYw6YVTcqlXvUudCNDAvDMl0DFQXw3XPGS9nfBI8GCINY3beNTBxk Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:42:34.214329 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}] Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 64ac40357265482ab0c20f4c840b7721 Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'f444dee2-6943-4c52-8664-eb2a5aa3c028'} Jul 20 09:42:34.215880 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. (HTTP 404) (Request-ID: req-d1f52917-3d25-408c-8941-2b2a2ddde1b7) Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.216921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:34.218173 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 09:42:34.219334 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-211f208d-1fef-4635-92d7-3fdd2f6b1f14 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Returning 404 to user: Snapshot f444dee2-6943-4c52-8664-eb2a5aa3c028 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-211f208d-1fef-4635-92d7-3fdd2f6b1f14 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028" status: 404 len: 111 microversion: 2.1 time: 0.033789 Jul 20 09:42:34.220701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 403/792] 10.222.0.18 () {58 vars in 1250 bytes} [Wed Jul 20 09:42:34 2022] GET /compute/v2.1/os-snapshots/f444dee2-6943-4c52-8664-eb2a5aa3c028 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:34.224993 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-99df79bd-42ef-4a97-9e5d-ca7697f4cba0 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f434af70>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:34.289033 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-99df79bd-42ef-4a97-9e5d-ca7697f4cba0 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 202 len: 0 microversion: 2.1 time: 0.067786 Jul 20 09:42:34.290158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 390/793] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:42:34 2022] DELETE /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:42:34.299796 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-862e0172-7705-4a72-b0b4-85cecb2cece8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f4203670>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:34.308485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-7153f2dc-df76-4e36-9c98-24b9c7fb5238 req-916ad071-60ce-4364-8ae2-2f48dff01dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4397e666-ea7d-4fa7-9108-fe0c21c44828", "tag": "81ddbb05-53a9-4a6b-98fe-2974fe70dcd9"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:34.319226 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7153f2dc-df76-4e36-9c98-24b9c7fb5238 req-916ad071-60ce-4364-8ae2-2f48dff01dba service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:34.319670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-7153f2dc-df76-4e36-9c98-24b9c7fb5238 req-916ad071-60ce-4364-8ae2-2f48dff01dba service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:34.335000 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-7153f2dc-df76-4e36-9c98-24b9c7fb5238 req-916ad071-60ce-4364-8ae2-2f48dff01dba service nova] Creating event network-changed:81ddbb05-53a9-4a6b-98fe-2974fe70dcd9 for instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 on hv-cinder-82282 Jul 20 09:42:34.343969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-7153f2dc-df76-4e36-9c98-24b9c7fb5238 req-916ad071-60ce-4364-8ae2-2f48dff01dba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039848 Jul 20 09:42:34.344742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 391/794] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:34.371570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-862e0172-7705-4a72-b0b4-85cecb2cece8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 200 len: 345 microversion: 2.1 time: 0.076381 Jul 20 09:42:34.372759 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 404/795] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:42:34 2022] GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:34.648515 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:34.649200 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:34.655939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:34.656376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:34.657124 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:34.657543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:35.043551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:35.044167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:35.050386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:35.050837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:35.051640 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:35.052667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:35.080783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:35.088426 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-41a6bd7b-afe9-4c0a-b647-9db1bc9496cd tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.444092 Jul 20 09:42:35.088993 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 392/796] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:34 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:35.183015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:35.190572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-52dbdc10-32e0-4de6-b8b3-749c44a6d289 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.151617 Jul 20 09:42:35.191152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 405/797] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:35 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:42:35.384640 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-144fe845-c3b9-42b1-98ab-e05798d7c84e tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f4387e50>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:35.412101 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-144fe845-c3b9-42b1-98ab-e05798d7c84e tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] HTTP exception thrown: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-144fe845-c3b9-42b1-98ab-e05798d7c84e tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Request method failure captured: Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a HTTP/1.1 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi184DbcpJNgaCxQqn8oO-bR_5aW58iyI9sncJgVo20eb3jJOWT4SQDCIhbqO43v-yP8CgNh3yhvVE5222dm6d49eYFv0dH9J7YTLly15pR0V8xrt-YGEKm5A5BZJYw6YVTcqlXvUudCNDAvDMl0DFQXw3XPGS9nfBI8GCINY3beNTBxk Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:35.416199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}] Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 64ac40357265482ab0c20f4c840b7721 Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '14d1f273-76b7-41cb-b115-5cce9131f72a'} Jul 20 09:42:35.417864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. (HTTP 404) (Request-ID: req-e7ad2f92-70e1-4bb9-8a21-54ede0da0cef) Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.418849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:35.420339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:42:35.421660 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-144fe845-c3b9-42b1-98ab-e05798d7c84e tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Returning 404 to user: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-144fe845-c3b9-42b1-98ab-e05798d7c84e tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 404 len: 109 microversion: 2.1 time: 0.036901 Jul 20 09:42:35.422893 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 393/798] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:42:35 2022] GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:35.431940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c561301b-41b9-4321-8403-1f6b9c7994f8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f41e8160>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:35.459515 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-c561301b-41b9-4321-8403-1f6b9c7994f8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] HTTP exception thrown: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c561301b-41b9-4321-8403-1f6b9c7994f8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Request method failure captured: Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a HTTP/1.1 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi184DbcpJNgaCxQqn8oO-bR_5aW58iyI9sncJgVo20eb3jJOWT4SQDCIhbqO43v-yP8CgNh3yhvVE5222dm6d49eYFv0dH9J7YTLly15pR0V8xrt-YGEKm5A5BZJYw6YVTcqlXvUudCNDAvDMl0DFQXw3XPGS9nfBI8GCINY3beNTBxk Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:42:35.461448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}] Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 64ac40357265482ab0c20f4c840b7721 Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '14d1f273-76b7-41cb-b115-5cce9131f72a'} Jul 20 09:42:35.463062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. (HTTP 404) (Request-ID: req-46051a55-3c1a-4c42-a35c-7452a17c4d8a) Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.464084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:42:35.465471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:42:35.466824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c561301b-41b9-4321-8403-1f6b9c7994f8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Returning 404 to user: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c561301b-41b9-4321-8403-1f6b9c7994f8 tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 404 len: 109 microversion: 2.1 time: 0.035348 Jul 20 09:42:35.468214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 406/799] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:42:35 2022] DELETE /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:35.471307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-98d9c11f-9aa1-4a90-a0fd-75ca5a8b8dee tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Calling method '.version_select at 0x7f81f8d1b310>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:35.499872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-98d9c11f-9aa1-4a90-a0fd-75ca5a8b8dee tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] HTTP exception thrown: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-98d9c11f-9aa1-4a90-a0fd-75ca5a8b8dee tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Request method failure captured: Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a HTTP/1.1 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi184DbcpJNgaCxQqn8oO-bR_5aW58iyI9sncJgVo20eb3jJOWT4SQDCIhbqO43v-yP8CgNh3yhvVE5222dm6d49eYFv0dH9J7YTLly15pR0V8xrt-YGEKm5A5BZJYw6YVTcqlXvUudCNDAvDMl0DFQXw3XPGS9nfBI8GCINY3beNTBxk Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:35.501798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c32d8605089a46a4a902e6b3a3590bb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c32d8605089a46a4a902e6b3a3590bb8"}]}] Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: c32d8605089a46a4a902e6b3a3590bb8 Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-130764235 Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 64ac40357265482ab0c20f4c840b7721 Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesSnapshotsTestJSON-130764235-project Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '14d1f273-76b7-41cb-b115-5cce9131f72a'} Jul 20 09:42:35.503318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. (HTTP 404) (Request-ID: req-065dd725-3dbc-4acb-ba79-1a042443781a) Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.504204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:42:35.505592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:42:35.506857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-98d9c11f-9aa1-4a90-a0fd-75ca5a8b8dee tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] Returning 404 to user: Volume 14d1f273-76b7-41cb-b115-5cce9131f72a could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-98d9c11f-9aa1-4a90-a0fd-75ca5a8b8dee tempest-VolumesSnapshotsTestJSON-130764235 tempest-VolumesSnapshotsTestJSON-130764235-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a" status: 404 len: 109 microversion: 2.1 time: 0.035648 Jul 20 09:42:35.508228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 394/800] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:42:35 2022] GET /compute/v2.1/os-volumes/14d1f273-76b7-41cb-b115-5cce9131f72a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:36.107663 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:36.108285 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:36.116097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:36.116558 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:36.117776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:36.118408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:36.208047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:36.208677 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:36.215316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:36.215786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:36.216560 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:36.216996 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:36.285692 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:36.293918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6c69a422-2f5c-4d9f-be0c-426391bad49f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.192889 Jul 20 09:42:36.295110 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 407/801] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:36 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:36.379753 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:36.387713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-09a69381-f1a3-468b-bf98-e046190dce8b tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.183454 Jul 20 09:42:36.388281 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 395/802] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:36 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:37.312203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:37.312974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:37.320001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:37.320448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:37.321207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:37.322395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:37.404922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:37.405521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:37.412047 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:37.412490 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:37.413520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:37.413946 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:37.470048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:37.479700 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0dfa8115-741e-4c68-941c-3958effda579 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.171521 Jul 20 09:42:37.483350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 408/803] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:37 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:37.560708 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:37.568273 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-866fa5ab-c397-4aa3-b9a6-8cfebeb832d6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.167116 Jul 20 09:42:37.573888 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 396/804] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:37 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:38.496870 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:38.497852 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:38.504239 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:38.504679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:38.505439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:38.505853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:38.590526 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:38.591128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:38.597609 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:38.598131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:38.598887 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:38.599328 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:38.603467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:38.648483 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:38.652386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:38.657089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-41d5347d-9f6b-49a8-adee-321518aa1a5d tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.165355 Jul 20 09:42:38.657655 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 409/805] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:38 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:38.751988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:38.761131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7657a12d-3b32-40e1-b094-63650fb29efa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.174488 Jul 20 09:42:38.761889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 397/806] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:38 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:38.881816 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e5af063e-8695-479e-bc21-124868189f41 req-8d7ce20e-dc8b-48b2-8167-0a75b4adb03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4397e666-ea7d-4fa7-9108-fe0c21c44828", "name": "network-vif-plugged", "status": "completed", "tag": "81ddbb05-53a9-4a6b-98fe-2974fe70dcd9"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:38.886857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=4 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:38.887769 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=12 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:38.895177 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5af063e-8695-479e-bc21-124868189f41 req-8d7ce20e-dc8b-48b2-8167-0a75b4adb03c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:38.895856 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5af063e-8695-479e-bc21-124868189f41 req-8d7ce20e-dc8b-48b2-8167-0a75b4adb03c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:38.909653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e5af063e-8695-479e-bc21-124868189f41 req-8d7ce20e-dc8b-48b2-8167-0a75b4adb03c service nova] Creating event network-vif-plugged:81ddbb05-53a9-4a6b-98fe-2974fe70dcd9 for instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 on hv-cinder-82282 Jul 20 09:42:38.918363 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e5af063e-8695-479e-bc21-124868189f41 req-8d7ce20e-dc8b-48b2-8167-0a75b4adb03c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Jul 20 09:42:38.919181 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 410/807] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:39.673795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:39.674393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:39.676358 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:39.682722 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:39.683239 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:39.684021 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:39.684445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:39.779348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:39.780047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:39.786533 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:39.787174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:39.788373 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:39.788977 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:39.815793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:39.823910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9dd5cea3-00bf-4e13-b688-0b4695861d45 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1314 microversion: 2.1 time: 0.153847 Jul 20 09:42:39.824675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 398/808] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:39 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:39.927403 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:39.935234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-dfa348fe-9f90-4b0e-a74a-83f149f48cd3 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.161060 Jul 20 09:42:39.935923 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 411/809] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:39 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:40.843280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:40.845523 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:40.854468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:40.856068 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:40.858516 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:40.859066 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:40.956877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:40.958362 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:40.970908 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:40.971988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:40.973256 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:40.974821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:41.026006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:41.034175 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-120c1aba-2f26-4a3e-9375-816a65705a3b tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1499 microversion: 2.1 time: 0.196987 Jul 20 09:42:41.034752 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 399/810] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:40 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:41.120419 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:41.128871 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a7282f84-62dd-4e14-82f5-2163524d59f0 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.178961 Jul 20 09:42:41.129557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 412/811] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:40 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:41.493720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:41.494207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:41.500682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:41.501120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:41.501873 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:41.502296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:41.527910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:42:41.606529 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5d803d09-c6bd-49f9-9a6b-57d73c8b0ce9 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 204 len: 0 microversion: 2.1 time: 0.116295 Jul 20 09:42:41.607229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 400/812] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:42:41 2022] DELETE /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:42:41.615605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:41.616289 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:41.623559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:41.624101 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:41.624857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:41.625280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:41.757218 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:41.765401 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fc653e26-0501-4973-8ed9-4731f1f2c27e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1505 microversion: 2.1 time: 0.153694 Jul 20 09:42:41.766068 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 413/813] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:41 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:42.146412 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:42.147383 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:42.154051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:42.154495 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:42.155245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:42.155713 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:42.300946 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:42.309920 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-82e83034-3673-4328-9c66-d7d83212b518 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.167659 Jul 20 09:42:42.310706 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 401/814] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:42 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:42.783620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:42.784335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:42.798487 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:42.799169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:42.800412 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:42.801310 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:42.935151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-ee863ae5-63cd-421c-a2e5-5ae9e96dd416 req-1880aa5f-57fe-459d-853f-68e580a36db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "name": "network-vif-plugged", "status": "completed", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:42.953253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-ee863ae5-63cd-421c-a2e5-5ae9e96dd416 req-1880aa5f-57fe-459d-853f-68e580a36db7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:42.953937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-ee863ae5-63cd-421c-a2e5-5ae9e96dd416 req-1880aa5f-57fe-459d-853f-68e580a36db7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:42.954650 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:42.964167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0e96d13a-72c2-4f28-ac5b-bdb0d728bdac tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1505 microversion: 2.1 time: 0.184900 Jul 20 09:42:42.973242 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 414/815] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:42 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:42.980115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-ee863ae5-63cd-421c-a2e5-5ae9e96dd416 req-1880aa5f-57fe-459d-853f-68e580a36db7 service nova] Creating event network-vif-plugged:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:42:42.985242 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-ee863ae5-63cd-421c-a2e5-5ae9e96dd416 req-1880aa5f-57fe-459d-853f-68e580a36db7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056747 Jul 20 09:42:42.985922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 402/816] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:42:43.326842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:43.327760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:43.334231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:43.334857 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:43.335917 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:43.336505 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:43.482538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:43.491460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-08cbc687-1ca6-4db5-adfd-4206c664a736 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1261 microversion: 2.1 time: 0.168222 Jul 20 09:42:43.492223 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 415/817] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:43 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:43.709031 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-9a402f64-38c5-4c49-90a2-e679fdbd4596 req-31b770ea-f506-4975-83ab-a8c59a8835c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4397e666-ea7d-4fa7-9108-fe0c21c44828", "name": "network-vif-deleted", "tag": "81ddbb05-53a9-4a6b-98fe-2974fe70dcd9"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:43.721506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-9a402f64-38c5-4c49-90a2-e679fdbd4596 req-31b770ea-f506-4975-83ab-a8c59a8835c8 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:43.722011 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-9a402f64-38c5-4c49-90a2-e679fdbd4596 req-31b770ea-f506-4975-83ab-a8c59a8835c8 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:43.734039 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-9a402f64-38c5-4c49-90a2-e679fdbd4596 req-31b770ea-f506-4975-83ab-a8c59a8835c8 service nova] Creating event network-vif-deleted:81ddbb05-53a9-4a6b-98fe-2974fe70dcd9 for instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 on hv-cinder-82282 Jul 20 09:42:43.739155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-9a402f64-38c5-4c49-90a2-e679fdbd4596 req-31b770ea-f506-4975-83ab-a8c59a8835c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034907 Jul 20 09:42:43.740062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 403/818] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:43.982206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:43.982759 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:43.989196 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:43.989665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:43.990427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:43.990850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.021116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:44.021557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.021997 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lazy-loading 'fault' on Instance uuid 4397e666-ea7d-4fa7-9108-fe0c21c44828 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:42:44.063683 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:44.071085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-08d1d50a-360c-4cfc-833a-3a5822fa31f0 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 200 len: 1304 microversion: 2.1 time: 0.093450 Jul 20 09:42:44.071662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 416/819] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:43 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:44.512605 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:44.513670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:44.520537 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:44.521265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.521992 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:44.522427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.653799 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:44.661367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-62951727-02ef-4e5a-8829-675a53d073a6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1444 microversion: 2.1 time: 0.155018 Jul 20 09:42:44.661930 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 404/820] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:44 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:44.678015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:44.678600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:44.684688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:44.685129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.685866 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:44.686291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:44.818090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:44.825858 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-58bc0260-9c48-412a-a4e6-f0760653a4d1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1444 microversion: 2.1 time: 0.151634 Jul 20 09:42:44.826436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 417/821] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:44 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:45.088778 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:45.089378 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 4397e666-ea7d-4fa7-9108-fe0c21c44828] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:45.097988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:45.098436 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:45.099212 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:45.099779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:45.117006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] HTTP exception thrown: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Request method failure captured: Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 HTTP/1.1 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi184Cd070BeylH0Q-l2uwBuoe2a3erHCyTx_lgbesprfoRryWpsB-sknzQc75rYhhBJYLpnNOwWn-43m_8NAfveiKprWZhR9_ue2MGgDsP9Iz27vEFc4ynZ5akDytFzNEM-GoRwTdmHpe-3olYmoLnOBG0sS4WB9LePME_S5X4M2f-kU Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 4f8dfa60d69d45c29013dbbe6c1dd226 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesActionsTest-752887214 Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:42:45.118654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f8dfa60d69d45c29013dbbe6c1dd226"}]}] Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesActionsTest-752887214 Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 4f8dfa60d69d45c29013dbbe6c1dd226 Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesActionsTest-752887214 Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesActionsTest-752887214-project Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 354e3e9955a74c1a86b7e4e6c9bbd512 Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesActionsTest-752887214-project Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. Jul 20 09:42:45.121102 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '4397e666-ea7d-4fa7-9108-fe0c21c44828'} Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:42:45.121968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. Jul 20 09:42:45.123431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:42:45.124597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Returning 404 to user: Instance 4397e666-ea7d-4fa7-9108-fe0c21c44828 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:42:45.124597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-007c844f-b209-4c5c-ade6-1cc8af8eedfe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828" status: 404 len: 111 microversion: 2.1 time: 0.035676 Jul 20 09:42:45.124597 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 405/822] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:45 2022] GET /compute/v2.1/servers/4397e666-ea7d-4fa7-9108-fe0c21c44828 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:42:45.222660 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-93221078", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "networks": [{"uuid": "678df20b-79c7-46fd-b30a-63d1f65355a4"}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:45.230002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:45.280712 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] validate_networks() for [('678df20b-79c7-46fd-b30a-63d1f65355a4', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:42:45.848872 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:42:45.849376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:42:45.849968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:42:45.850377 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:42:45.850905 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:42:45.860665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:45.861104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:45.861887 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:45.862315 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:45.879124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Getting quotas for project 4f8dfa60d69d45c29013dbbe6c1dd226. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:42:45.883265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Getting quotas for user 354e3e9955a74c1a86b7e4e6c9bbd512 and project 4f8dfa60d69d45c29013dbbe6c1dd226. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:42:45.894437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:42:45.896850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:42:45.945206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-dc4c4b7e-7ad4-4674-8076-4ca3f7437443 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726274 Jul 20 09:42:45.950756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 418/823] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:42:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:42:45.956113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ac7268f5-93ef-41e8-9e79-a9f1c83f9685 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:45.956956 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ac7268f5-93ef-41e8-9e79-a9f1c83f9685 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:46.021936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ac7268f5-93ef-41e8-9e79-a9f1c83f9685 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:46.029916 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ac7268f5-93ef-41e8-9e79-a9f1c83f9685 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1212 microversion: 2.1 time: 0.077576 Jul 20 09:42:46.042381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 406/824] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:45 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:47.049702 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:47.051080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:47.058049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:47.058498 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:47.059455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:47.059897 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:47.158886 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:47.168549 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-cdf6326d-32be-4e17-99bc-ecd3b260bf54 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1272 microversion: 2.1 time: 0.123497 Jul 20 09:42:47.169226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 419/825] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:47 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:47.387646 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-4a54b9a1-646d-42ff-b8bc-74bb23ffe616 req-d541c4f7-1181-4b42-bee7-78e4a77f872d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:47.411254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4a54b9a1-646d-42ff-b8bc-74bb23ffe616 req-d541c4f7-1181-4b42-bee7-78e4a77f872d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:47.412026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-4a54b9a1-646d-42ff-b8bc-74bb23ffe616 req-d541c4f7-1181-4b42-bee7-78e4a77f872d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:47.434041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-4a54b9a1-646d-42ff-b8bc-74bb23ffe616 req-d541c4f7-1181-4b42-bee7-78e4a77f872d service nova] Creating event network-changed:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:42:47.446846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-4a54b9a1-646d-42ff-b8bc-74bb23ffe616 req-d541c4f7-1181-4b42-bee7-78e4a77f872d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062965 Jul 20 09:42:47.446846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 407/826] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:48.186515 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:48.187910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:48.194598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:48.195084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:48.196147 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:48.196962 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:48.297134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:48.306194 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-787413bd-58f7-4791-a460-bb716e9fbc55 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1270 microversion: 2.1 time: 0.123968 Jul 20 09:42:48.307600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 420/827] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:48 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:49.312767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-06acf9a9-94c0-46ab-af47-5fb6c297e2f7 req-3642c64c-5c6b-4cfc-a754-3be7afff5e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e5ce43d-a064-4e16-ba4e-c6814d4104b2", "tag": "2ed8cac7-63d1-4818-881b-6b7056cbc868"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:49.322533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-06acf9a9-94c0-46ab-af47-5fb6c297e2f7 req-3642c64c-5c6b-4cfc-a754-3be7afff5e7d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:49.323057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-06acf9a9-94c0-46ab-af47-5fb6c297e2f7 req-3642c64c-5c6b-4cfc-a754-3be7afff5e7d service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:49.326597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:49.329872 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:49.340585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-06acf9a9-94c0-46ab-af47-5fb6c297e2f7 req-3642c64c-5c6b-4cfc-a754-3be7afff5e7d service nova] Creating event network-changed:2ed8cac7-63d1-4818-881b-6b7056cbc868 for instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 on hv-cinder-82282 Jul 20 09:42:49.342830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:49.343335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:49.344145 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:49.344588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:49.345931 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-06acf9a9-94c0-46ab-af47-5fb6c297e2f7 req-3642c64c-5c6b-4cfc-a754-3be7afff5e7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036981 Jul 20 09:42:49.347080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 408/828] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:49.493788 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:49.501795 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e7f476cc-1eb7-41bb-ac8d-b867b95f26fe tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.181020 Jul 20 09:42:49.502368 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 421/829] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:49 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:50.520128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:50.520820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:50.527741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:50.528182 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:50.528933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:50.529359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:50.660440 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:50.669433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d088b37a-31b7-4452-aa12-624d2c0f6fa5 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.153883 Jul 20 09:42:50.679027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 409/830] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:50 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:51.686538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:51.687136 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:51.693620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:51.694055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:51.694845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:51.695220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:51.829847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:51.837258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8cb41259-704f-49a6-bfa1-551d7d8ccde1 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.154598 Jul 20 09:42:51.837813 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 422/831] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:51 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:52.855088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:52.855844 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:52.858501 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:52.863894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:52.864411 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:52.865238 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:52.865734 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:53.013085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:53.023043 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-068f1414-0aea-46bc-a1ee-8458bf6e3592 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.172446 Jul 20 09:42:53.023863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 410/832] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:52 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:54.042793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:54.043436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:54.049818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:54.050255 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:54.051001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:54.051461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:54.189291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:54.197681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bf3ea6f0-3cb7-4693-971b-34b2fb0d69c6 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.159549 Jul 20 09:42:54.198372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 423/833] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:54 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:54.997705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-29a7143c-6e96-4d62-b062-27ace109f509 req-32df7b32-6ae1-469a-9639-8096a9100223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5ce43d-a064-4e16-ba4e-c6814d4104b2", "name": "network-vif-plugged", "status": "completed", "tag": "2ed8cac7-63d1-4818-881b-6b7056cbc868"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:42:55.007654 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-29a7143c-6e96-4d62-b062-27ace109f509 req-32df7b32-6ae1-469a-9639-8096a9100223 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:55.008103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-29a7143c-6e96-4d62-b062-27ace109f509 req-32df7b32-6ae1-469a-9639-8096a9100223 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:55.021355 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-29a7143c-6e96-4d62-b062-27ace109f509 req-32df7b32-6ae1-469a-9639-8096a9100223 service nova] Creating event network-vif-plugged:2ed8cac7-63d1-4818-881b-6b7056cbc868 for instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 on hv-cinder-82282 Jul 20 09:42:55.027572 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-29a7143c-6e96-4d62-b062-27ace109f509 req-32df7b32-6ae1-469a-9639-8096a9100223 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033856 Jul 20 09:42:55.029289 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 411/834] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:42:55.214088 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:55.214730 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:55.221517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:55.221965 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:55.222759 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:55.223190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:55.355460 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:55.363123 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-692bc018-53b5-4b23-8867-2e95e8c54516 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.152978 Jul 20 09:42:55.363685 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 424/835] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:55 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:56.378359 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:56.383581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:56.384297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:56.391856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:56.392291 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:56.393050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:56.393477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:56.533296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:56.541091 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-61b60763-e3ad-467c-954c-cb26fafa935f tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1312 microversion: 2.1 time: 0.164106 Jul 20 09:42:56.541679 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 412/836] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:56 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:42:57.557530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:57.558141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:57.560165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:57.560821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:57.567592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.568040 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:57.568801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.569237 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:57.709308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:57.717599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3ba546e5-a335-450b-a73d-47147e174bf4 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1497 microversion: 2.1 time: 0.163987 Jul 20 09:42:57.718167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 425/837] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:57 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:42:57.877350 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:57.879044 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:57.885999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.886447 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:57.889310 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.889765 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:57.919921 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ab19a578-fe8e-42a2-a74f-c96edb6a871d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046849 Jul 20 09:42:57.920633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 413/838] 10.222.0.18 () {60 vars in 1342 bytes} [Wed Jul 20 09:42:57 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:42:57.984180 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:57.984781 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:57.992416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.992745 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:57.993516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:57.993945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.019765 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:42:58.048072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=100 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:42:58.117143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fc749db3-f261-432d-9130-cbe47b35e652 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 204 len: 0 microversion: 2.20 time: 0.137685 Jul 20 09:42:58.118079 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 426/839] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jul 20 09:42:57 2022] DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:42:58.127417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:58.128034 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:58.134421 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.134960 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.135884 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.136376 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.179015 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:58.179621 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:58.186169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.186774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.187673 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.188104 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.215200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:42:58.292884 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6096df69-da97-4f32-85a9-9fbe8f7f5f4e tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 204 len: 0 microversion: 2.1 time: 0.117844 Jul 20 09:42:58.293680 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 427/840] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:42:58 2022] DELETE /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:42:58.293963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:58.302142 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:58.302361 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:58.302835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:58.303666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:58.304808 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-df0a9ac4-7602-4b83-b001-aff583403c44 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.181679 Jul 20 09:42:58.305348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 414/841] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:58 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:58.314355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.314832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.315744 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:58.316281 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:58.451073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:58.458582 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3135c629-394c-4b3d-b7b4-fbac3ebefc19 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1503 microversion: 2.1 time: 0.160435 Jul 20 09:42:58.459141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 428/842] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:58 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:42:59.325323 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:59.325912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:59.332391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:59.332825 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:59.333566 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:59.333991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:59.470870 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:59.475672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:42:59.476278 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:42:59.478795 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:59.480336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:59.481499 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7c145983-cc04-49ab-8f65-bbe19978ad83 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.160499 Jul 20 09:42:59.482059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 415/843] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:42:59 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:42:59.482802 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:59.483240 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:59.484020 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:42:59.484447 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:42:59.614658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:42:59.623262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-18575837-7e8c-4791-acf3-14a1a1c7956a tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1503 microversion: 2.1 time: 0.151339 Jul 20 09:42:59.623833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 429/844] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:42:59 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:43:00.499692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:00.500234 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:00.506596 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:00.507040 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:00.507817 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:00.508248 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:00.639840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:00.640228 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:00.640832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:00.647309 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:00.647762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:00.647936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:00.648513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:00.648936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:00.649430 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:00.650600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2be69010-96bf-4ceb-ba50-122dc0d83fbb tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.154936 Jul 20 09:43:00.651369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 416/845] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:00 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:43:00.784525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:00.793131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-76323a88-b1ca-4ef3-9f62-55fe847f3c11 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1503 microversion: 2.1 time: 0.157252 Jul 20 09:43:00.793706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 430/846] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:00 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:43:01.669821 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:01.670452 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:01.676925 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:01.677364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:01.678119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:01.678548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:01.681088 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:01.810070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:01.810668 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:01.817348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:01.817797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:01.818564 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:01.818993 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:01.955018 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '354e3e9955a74c1a86b7e4e6c9bbd512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8dfa60d69d45c29013dbbe6c1dd226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:01.963277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b152f3bc-a452-481f-89f1-c61fa50845db tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 200 len: 1503 microversion: 2.1 time: 0.157042 Jul 20 09:43:01.964000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 431/847] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:01 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:43:01.997309 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:02.005467 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:02.006955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:02.008164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a9732f3c-fd89-4cfe-9268-50e255fc461c tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1721 microversion: 2.20 time: 0.342323 Jul 20 09:43:02.008709 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 417/848] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:01 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:43:02.227665 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e5036083-a4ae-4a91-86be-4930e074e0c6 req-5c611ff9-c147-4c39-9ecf-2ea4b936c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e5ce43d-a064-4e16-ba4e-c6814d4104b2", "name": "network-vif-deleted", "tag": "2ed8cac7-63d1-4818-881b-6b7056cbc868"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:02.237146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5036083-a4ae-4a91-86be-4930e074e0c6 req-5c611ff9-c147-4c39-9ecf-2ea4b936c3c2 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:02.237600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5036083-a4ae-4a91-86be-4930e074e0c6 req-5c611ff9-c147-4c39-9ecf-2ea4b936c3c2 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:02.259150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e5036083-a4ae-4a91-86be-4930e074e0c6 req-5c611ff9-c147-4c39-9ecf-2ea4b936c3c2 service nova] Creating event network-vif-deleted:2ed8cac7-63d1-4818-881b-6b7056cbc868 for instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 on hv-cinder-82282 Jul 20 09:43:02.264141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e5036083-a4ae-4a91-86be-4930e074e0c6 req-5c611ff9-c147-4c39-9ecf-2ea4b936c3c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040407 Jul 20 09:43:02.264748 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 432/849] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:02.982966 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:02.983771 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] [instance: 1e5ce43d-a064-4e16-ba4e-c6814d4104b2] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:02.991145 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:02.992201 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:02.993449 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:02.994206 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:03.012808 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] HTTP exception thrown: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Request method failure captured: Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 HTTP/1.1 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi184Cd070BeylH0Q-l2uwBuoe2a3erHCyTx_lgbesprfoRryWpsB-sknzQc75rYhhBJYLpnNOwWn-43m_8NAfveiKprWZhR9_ue2MGgDsP9Iz27vEFc4ynZ5akDytFzNEM-GoRwTdmHpe-3olYmoLnOBG0sS4WB9LePME_S5X4M2f-kU Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 4f8dfa60d69d45c29013dbbe6c1dd226 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesActionsTest-752887214 Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:43:03.015186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f8dfa60d69d45c29013dbbe6c1dd226"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f8dfa60d69d45c29013dbbe6c1dd226"}]}] Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesActionsTest-752887214 Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 4f8dfa60d69d45c29013dbbe6c1dd226 Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesActionsTest-752887214 Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesActionsTest-752887214-project Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 354e3e9955a74c1a86b7e4e6c9bbd512 Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesActionsTest-752887214-project Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. Jul 20 09:43:03.016860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '1e5ce43d-a064-4e16-ba4e-c6814d4104b2'} Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:03.017772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. Jul 20 09:43:03.019230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:03.023059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] Returning 404 to user: Instance 1e5ce43d-a064-4e16-ba4e-c6814d4104b2 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:03.023059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-276f76bf-ebbb-4142-af43-c8852b9cd821 tempest-VolumesActionsTest-752887214 tempest-VolumesActionsTest-752887214-project] 10.222.0.18 "GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2" status: 404 len: 111 microversion: 2.1 time: 0.040086 Jul 20 09:43:03.023059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 418/850] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:02 2022] GET /compute/v2.1/servers/1e5ce43d-a064-4e16-ba4e-c6814d4104b2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:43:03.032437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:03.033294 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:03.047105 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:03.048921 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:03.051022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:03.052566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:03.100747 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:03.101538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:03.102469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lazy-loading 'fault' on Instance uuid 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:43:03.162246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:03.190694 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:03.196529 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a37198e6d4424a51800655d3bd0a3ee6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07eb1473648d490b90a1e7debc45d57d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:03.197772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-617519f7-32e2-4db0-ba75-caf57c1ba842 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 200 len: 1370 microversion: 2.20 time: 0.171990 Jul 20 09:43:03.198678 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 433/851] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:03 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:43:04.216498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:04.217103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:04.224551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:04.224991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:04.225742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:04.226175 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:04.239974 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 HTTP/1.1 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:43:04.241494 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:04.243177 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '8c1aa3a0-cf51-4942-abc5-e059ed3eca20'} Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:04.244479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:04.246077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:04.248213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:04.248213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7ad55e2c-396c-4bf3-9b7b-736622d15fe8 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 404 len: 111 microversion: 2.20 time: 0.031011 Jul 20 09:43:04.248213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 419/852] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:04 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:43:04.252343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1286fedf-6cbf-48c7-b588-ce4617149f33 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '.version_select at 0x7f81f42b2040>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:04.271606 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1286fedf-6cbf-48c7-b588-ce4617149f33 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763394623" status: 204 len: 0 microversion: 2.20 time: 0.023330 Jul 20 09:43:04.272176 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 434/853] 10.222.0.18 () {60 vars in 1258 bytes} [Wed Jul 20 09:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763394623 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:43:04.286015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-8a4bc75f-db51-4d3d-8bc7-c38efad3caff req-cb717d16-2116-4f21-964e-28c1933041c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1aa3a0-cf51-4942-abc5-e059ed3eca20", "name": "network-vif-deleted", "tag": "859157aa-b638-4b4f-b43f-7f70703c0a47"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:04.310640 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8a4bc75f-db51-4d3d-8bc7-c38efad3caff req-cb717d16-2116-4f21-964e-28c1933041c3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:04.311215 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8a4bc75f-db51-4d3d-8bc7-c38efad3caff req-cb717d16-2116-4f21-964e-28c1933041c3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:04.328594 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-8a4bc75f-db51-4d3d-8bc7-c38efad3caff req-cb717d16-2116-4f21-964e-28c1933041c3 service nova] Creating event network-vif-deleted:859157aa-b638-4b4f-b43f-7f70703c0a47 for instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 on hv-cinder-82282 Jul 20 09:43:04.333348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-8a4bc75f-db51-4d3d-8bc7-c38efad3caff req-cb717d16-2116-4f21-964e-28c1933041c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051243 Jul 20 09:43:04.333938 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 420/854] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:43:08.141851 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:08.142378 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:08.148913 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:08.149361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:08.150116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:08.150545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:08.164655 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 HTTP/1.1 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:43:08.166348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.167988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '8c1aa3a0-cf51-4942-abc5-e059ed3eca20'} Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:08.168768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.170273 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.172398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:08.172398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9dcf8f56-dced-474d-8f70-7180bffe3fa3 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 404 len: 111 microversion: 2.20 time: 0.030229 Jul 20 09:43:08.172398 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 435/855] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jul 20 09:43:08 2022] DELETE /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:43:08.177566 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:08.178285 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 8c1aa3a0-cf51-4942-abc5-e059ed3eca20] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:08.185105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:08.185542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:08.186294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:08.186717 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:08.201879 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 HTTP/1.1 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:43:08.203563 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.205194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '8c1aa3a0-cf51-4942-abc5-e059ed3eca20'} Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:08.205958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. Jul 20 09:43:08.207162 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:08.208312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 8c1aa3a0-cf51-4942-abc5-e059ed3eca20 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:08.208312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bc826ea3-cfb4-4325-b1bd-f41525e07a63 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20" status: 404 len: 111 microversion: 2.20 time: 0.032450 Jul 20 09:43:08.208312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 421/856] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:08 2022] GET /compute/v2.1/servers/8c1aa3a0-cf51-4942-abc5-e059ed3eca20 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:43:09.366071 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:09.366723 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:09.374634 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:09.375167 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:09.376055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:09.376701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:09.392178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d HTTP/1.1 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:43:09.393969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.395486 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '449aaf77-3ec6-4163-bc11-ce226c2ca23d'} Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:09.396277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.397550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.400351 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:09.401224 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-644d35c5-51c9-4083-ab1e-78acc0a06479 tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 404 len: 111 microversion: 2.20 time: 0.039303 Jul 20 09:43:09.401797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 436/857] 10.222.0.18 () {60 vars in 1279 bytes} [Wed Jul 20 09:43:09 2022] DELETE /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 09:43:09.414585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:09.415691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] [instance: 449aaf77-3ec6-4163-bc11-ce226c2ca23d] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:09.425173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:09.426281 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:09.428500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:09.429530 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:09.455420 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] HTTP exception thrown: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Request method failure captured: Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d HTTP/1.1 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi18x3Gu0MMbM4fBPI9omzHjraEA7CbYdlcQc2P3EZbFEnFFuu84jwprihy_OpS2GG9sbybF3jQ0KZwgd7aBylkd82bZpzdJ_P2kttGK8DY9LmNGTBouV9kL-stPmxuQ2iGFRXBF6SSF7dTDSb--Xgf2BwSuXGpxc4WhCWk8V6Gf-Zur4 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:43:09.459128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/07eb1473648d490b90a1e7debc45d57d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/07eb1473648d490b90a1e7debc45d57d"}]}] Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 07eb1473648d490b90a1e7debc45d57d Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-951470208 Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: a37198e6d4424a51800655d3bd0a3ee6 Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeShelveTestJSON-951470208-project Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.461304 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '449aaf77-3ec6-4163-bc11-ce226c2ca23d'} Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:43:09.462254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. Jul 20 09:43:09.464329 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:43:09.468170 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] Returning 404 to user: Instance 449aaf77-3ec6-4163-bc11-ce226c2ca23d could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:43:09.469926 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-cfbaf9e7-8b3a-4829-add4-3f6692fa312d tempest-AttachVolumeShelveTestJSON-951470208 tempest-AttachVolumeShelveTestJSON-951470208-project] 10.222.0.18 "GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d" status: 404 len: 111 microversion: 2.20 time: 0.061286 Jul 20 09:43:09.474272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 422/858] 10.222.0.18 () {60 vars in 1276 bytes} [Wed Jul 20 09:43:09 2022] GET /compute/v2.1/servers/449aaf77-3ec6-4163-bc11-ce226c2ca23d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:43:20.593945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:20.596502 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=56,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:21.023527 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ea5c1962-deae-4f92-9bab-76c9cfc0cc38 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: .version_select at 0x7f81f42b28b0>, body: {"keypair": {"name": "tempest-keypair-1987997939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDAQhsIqilY1eiLXL0OBE+t8MnE6saEO9gFyA8wNSnMUUk8T/Ks5L2n1YzEsm7lw+N3DFe+bZKQd3j/2wcxLG6cm45SC62SVbatloKa4j8I8EARDGRAD+Qsg64jC90Hrw=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:21.048833 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-ea5c1962-deae-4f92-9bab-76c9cfc0cc38 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:43:21.053751 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-ea5c1962-deae-4f92-9bab-76c9cfc0cc38 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:43:21.094842 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ea5c1962-deae-4f92-9bab-76c9cfc0cc38 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507851 Jul 20 09:43:21.099338 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 437/859] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:43:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:43:22.821134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-471947882", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6671a0fd-e3f4-4bae-a778-86d0bc616f5d"}], "security_groups": [{"name": "tempest-securitygroup--1476744376"}], "key_name": "tempest-keypair-1987997939", "user_data": "}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:22.835836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=25 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:22.836480 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=15 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:22.968254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] validate_networks() for [('6671a0fd-e3f4-4bae-a778-86d0bc616f5d', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:43:23.531830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:43:23.532406 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:43:23.533190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:43:23.533817 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:43:23.534457 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:43:23.552972 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:23.554190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:23.555307 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:23.556013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:23.593656 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:43:23.608910 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:43:23.628098 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:43:23.630399 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:43:23.723313 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-72669d17-ded6-40bf-b331-edd207adb4da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.907092 Jul 20 09:43:23.724508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 423/860] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:43:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 09:43:23.735551 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-74985187-4e9c-4169-b583-b517d0476870 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:23.737558 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-74985187-4e9c-4169-b583-b517d0476870 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:23.850482 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-74985187-4e9c-4169-b583-b517d0476870 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:23.861226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-74985187-4e9c-4169-b583-b517d0476870 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1241 microversion: 2.1 time: 0.130619 Jul 20 09:43:23.862400 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 438/861] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:23 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:24.880979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:24.882480 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:24.896119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:24.898804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:24.899897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:24.904274 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:24.975806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:24.985598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-34d3b8da-c373-48b4-8033-7a7fdc6f30a5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1245 microversion: 2.1 time: 0.111166 Jul 20 09:43:24.986761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 424/862] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:24 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:26.002762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:26.004274 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:26.020138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:26.020752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:26.021593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:26.022154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:26.088103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:26.100184 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3cd8545c-9ae2-4029-bb1b-628b13141bd5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1237 microversion: 2.1 time: 0.099418 Jul 20 09:43:26.101528 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 439/863] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:25 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:27.118962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:27.119733 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:27.127048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:27.127602 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:27.128370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:27.128800 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:27.206789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:27.214133 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7bae12a7-5a17-4806-a6f5-382aea18a3e5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1299 microversion: 2.1 time: 0.099146 Jul 20 09:43:27.215020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 425/864] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:27 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:28.231413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:28.232547 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:28.239844 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:28.240593 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:28.241497 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:28.242154 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:28.392664 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:28.400540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-91b28c48-2b70-49af-b188-09c3c35a1490 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.173785 Jul 20 09:43:28.401768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 440/865] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:28 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:28.485346 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-c4efb013-f1aa-4b09-b704-8b6510146ddc req-35adbd1d-e2ba-40cf-81ef-9fc0cb1c0f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac77738b-4bd2-4a70-b5f1-50f154fbf3f1", "tag": "c2e36cbd-e333-4f09-b744-1b79cceb1f5f"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:28.502822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-c4efb013-f1aa-4b09-b704-8b6510146ddc req-35adbd1d-e2ba-40cf-81ef-9fc0cb1c0f6b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:28.504271 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-c4efb013-f1aa-4b09-b704-8b6510146ddc req-35adbd1d-e2ba-40cf-81ef-9fc0cb1c0f6b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:28.521690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-c4efb013-f1aa-4b09-b704-8b6510146ddc req-35adbd1d-e2ba-40cf-81ef-9fc0cb1c0f6b service nova] Creating event network-changed:c2e36cbd-e333-4f09-b744-1b79cceb1f5f for instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 on hv-cinder-82282 Jul 20 09:43:28.528637 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-c4efb013-f1aa-4b09-b704-8b6510146ddc req-35adbd1d-e2ba-40cf-81ef-9fc0cb1c0f6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046315 Jul 20 09:43:28.529746 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 426/866] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:29.418752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:29.419544 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:29.426140 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:29.426586 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:29.427356 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:29.427798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:29.566926 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:29.574937 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-52a0e0c2-7d15-46a2-9304-e5c596cc3264 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.160588 Jul 20 09:43:29.575536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 441/867] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:29 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:30.593979 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:30.595279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:30.603075 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:30.603830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:30.604866 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:30.605296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:30.764538 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:30.772896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3630e4d2-4281-45d7-9efe-ad4742cd7729 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.184757 Jul 20 09:43:30.773500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 427/868] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:30 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:31.790952 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:31.791592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:31.798530 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:31.798980 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:31.799772 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:31.800203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:32.180292 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:32.189466 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-be9c89de-6f08-41c9-b8f1-6b7bd74eb3d4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.402738 Jul 20 09:43:32.190652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 442/869] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:31 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:43:33.213197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:33.215146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:33.238214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:33.243084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:33.250358 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:33.250874 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:33.441770 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:33.452122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-31b4e0cf-3850-412e-b2cd-276e878d3bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.248316 Jul 20 09:43:33.452894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 428/870] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:33 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:34.477084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:34.482032 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:34.486428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:34.490834 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:34.491768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:34.492592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:34.493934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:34.608240 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-8c81fcef-9310-4f9b-b829-17d10116ffeb req-a5210b16-2324-4a8d-a5c0-316bda3e3726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac77738b-4bd2-4a70-b5f1-50f154fbf3f1", "name": "network-vif-plugged", "status": "completed", "tag": "c2e36cbd-e333-4f09-b744-1b79cceb1f5f"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:34.622856 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:34.623698 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:34.632937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8c81fcef-9310-4f9b-b829-17d10116ffeb req-a5210b16-2324-4a8d-a5c0-316bda3e3726 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:34.634004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8c81fcef-9310-4f9b-b829-17d10116ffeb req-a5210b16-2324-4a8d-a5c0-316bda3e3726 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:34.701832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-8c81fcef-9310-4f9b-b829-17d10116ffeb req-a5210b16-2324-4a8d-a5c0-316bda3e3726 service nova] Creating event network-vif-plugged:c2e36cbd-e333-4f09-b744-1b79cceb1f5f for instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 on hv-cinder-82282 Jul 20 09:43:34.715807 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-8c81fcef-9310-4f9b-b829-17d10116ffeb req-a5210b16-2324-4a8d-a5c0-316bda3e3726 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110507 Jul 20 09:43:34.717026 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 429/871] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:34.820550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:34.844761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-daf8635c-4880-40ea-b8fc-75c5690854f6 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.375726 Jul 20 09:43:34.847868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 443/872] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:34 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:35.862670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:35.863481 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:35.869697 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:35.870658 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:35.871628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:35.872230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:36.044454 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:36.055963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a8e362ad-5a39-45a1-a917-c794824f52cf tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1367 microversion: 2.1 time: 0.195869 Jul 20 09:43:36.067030 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 430/873] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:35 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:37.073869 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:37.077674 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:37.090346 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:37.090999 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:37.093347 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:37.095141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:37.327801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:37.344620 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-fa7fcdba-f467-4cd2-aa7f-4de7b006a79c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1558 microversion: 2.1 time: 0.270123 Jul 20 09:43:37.351968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 444/874] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:37 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1558 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:37.363253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:37.365272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:37.373838 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:37.374704 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:37.376442 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:37.381363 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:37.497327 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-378c5b2a-228e-4e7f-8a73-c3ca33552ed4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138130 Jul 20 09:43:37.504079 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 431/875] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:43:37 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:38.985606 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-0b699ba9-d7f6-49f9-aa41-5e0b480d95f3 req-b746520c-33f8-4132-849f-7dbbc4188337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac77738b-4bd2-4a70-b5f1-50f154fbf3f1", "tag": "c2e36cbd-e333-4f09-b744-1b79cceb1f5f"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:38.999349 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-0b699ba9-d7f6-49f9-aa41-5e0b480d95f3 req-b746520c-33f8-4132-849f-7dbbc4188337 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:38.999733 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-0b699ba9-d7f6-49f9-aa41-5e0b480d95f3 req-b746520c-33f8-4132-849f-7dbbc4188337 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:39.023316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-0b699ba9-d7f6-49f9-aa41-5e0b480d95f3 req-b746520c-33f8-4132-849f-7dbbc4188337 service nova] Creating event network-changed:c2e36cbd-e333-4f09-b744-1b79cceb1f5f for instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 on hv-cinder-82282 Jul 20 09:43:39.031969 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-0b699ba9-d7f6-49f9-aa41-5e0b480d95f3 req-b746520c-33f8-4132-849f-7dbbc4188337 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048312 Jul 20 09:43:39.037083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 445/876] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:42.437731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8e6e9b5c-890e-4735-b909-f16afc14f6ec tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Action: 'create', calling method: .version_select at 0x7f81f438ec10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-926131090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxV9fs+E3lJNi+iG3abatqWtpZGXyQTpDtstXky8Uq9m9U0aLiuUjdiqDBm7G5/6BHl8/iH9PYIcUuC8D5dxhBLkQbdqai+P+lkfE2eDepGm1BPx5zJyf/swL2IgtaAw=="}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:42.451793 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-8e6e9b5c-890e-4735-b909-f16afc14f6ec tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for project 42a88572ee8443d4a51617c04ca2f416. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:43:42.455531 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-8e6e9b5c-890e-4735-b909-f16afc14f6ec tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for user ac343929fc8542439bc627a1f445b1dd and project 42a88572ee8443d4a51617c04ca2f416. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:43:42.477964 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8e6e9b5c-890e-4735-b909-f16afc14f6ec tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.281914 Jul 20 09:43:42.478554 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 432/877] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:43:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:43:58.011208 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1174915823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-926131090", "security_groups": [{"name": "tempest-secgroup-smoke-1069216155"}], "block_device_mapping_v2": [{"uuid": "474ea8ba-85ca-46c4-8014-012de0940cca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49ad933c-e19c-4fd1-95f5-c5db07071624"}]}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:43:58.019584 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:58.020226 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=38 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:58.125866 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] validate_networks() for [('49ad933c-e19c-4fd1-95f5-c5db07071624', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:43:58.499442 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:43:58.499859 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:43:58.500353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:43:58.500754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:43:58.501155 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:43:58.509855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:58.510348 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:58.511279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:58.511741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:58.528403 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:43:58.532307 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for user ac343929fc8542439bc627a1f445b1dd and project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:43:58.588639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:43:58.590799 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='474ea8ba-85ca-46c4-8014-012de0940cca',volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:43:58.713959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-25f1be3f-917b-4ad2-a6ae-447373aa2817 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707505 Jul 20 09:43:58.714597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 446/878] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:43:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:43:58.721977 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=40 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:58.723508 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:58.724035 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:43:58.727803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9a3804b3-5610-48d6-8570-bef5852dca5a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:58.728398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9a3804b3-5610-48d6-8570-bef5852dca5a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:58.785300 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9a3804b3-5610-48d6-8570-bef5852dca5a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:58.792701 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9a3804b3-5610-48d6-8570-bef5852dca5a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1094 microversion: 2.1 time: 0.072185 Jul 20 09:43:58.793393 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 433/879] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:58 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:43:59.810185 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:43:59.810818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:43:59.818801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:59.819553 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:59.820328 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:43:59.820761 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:43:59.888520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:43:59.903143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a827320d-e585-4edf-a7ee-98dd45a0d14b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1200 microversion: 2.1 time: 0.097260 Jul 20 09:43:59.903871 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 447/880] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:43:59 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:00.921061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:00.921889 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:00.928487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:00.929065 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:00.929830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:00.930263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:01.138245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:01.145642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d4c1db1e-4dd0-48e4-860a-2fc8fb376789 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.229022 Jul 20 09:44:01.146326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 434/881] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:00 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:01.502716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-007ac3d7-34e8-4431-a212-dae71c1a8357 req-6b9afa9b-5001-451a-aa04-6f8ab36e87c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb063d3-178c-44c1-bc45-828171804bff", "tag": "e293b286-c896-48c7-b609-1a4f9bd4117a"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:01.512928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-007ac3d7-34e8-4431-a212-dae71c1a8357 req-6b9afa9b-5001-451a-aa04-6f8ab36e87c6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:01.513395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-007ac3d7-34e8-4431-a212-dae71c1a8357 req-6b9afa9b-5001-451a-aa04-6f8ab36e87c6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:01.536445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-007ac3d7-34e8-4431-a212-dae71c1a8357 req-6b9afa9b-5001-451a-aa04-6f8ab36e87c6 service nova] Creating event network-changed:e293b286-c896-48c7-b609-1a4f9bd4117a for instance acb063d3-178c-44c1-bc45-828171804bff on hv-cinder-82282 Jul 20 09:44:01.542241 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-007ac3d7-34e8-4431-a212-dae71c1a8357 req-6b9afa9b-5001-451a-aa04-6f8ab36e87c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042808 Jul 20 09:44:01.543231 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 448/882] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:02.162774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:02.163423 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:02.170154 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:02.170596 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:02.171382 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:02.171811 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:02.402562 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:02.410121 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c3363f69-b5a0-4021-b391-6cc9af68d3ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.251257 Jul 20 09:44:02.410891 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 435/883] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:02 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:03.428414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:03.429111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:03.436028 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:03.436474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:03.437235 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:03.437706 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:03.574874 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:03.582584 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7fdc8421-b4a9-49b3-8663-0616068a5d8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.158837 Jul 20 09:44:03.583156 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 449/884] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:03 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:04.599142 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:04.599789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:04.606199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:04.606642 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:04.607419 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:04.607852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:04.741255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:04.749517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d9602322-71eb-4c03-b69f-4cc312a1acac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.154194 Jul 20 09:44:04.750069 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 436/885] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:04 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:05.766361 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:05.766973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:05.773459 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:05.773925 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:05.774658 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:05.775089 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:05.903118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:05.910570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-79dd5333-81c7-4032-9c9a-881b111abdbb tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.148108 Jul 20 09:44:05.911128 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 450/886] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:05 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:06.928392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:06.928997 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:06.936090 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:06.936533 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:06.937290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:06.937724 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:07.069122 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:07.076588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2809315a-8969-48e2-9947-cb12eb3e19ba tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.152040 Jul 20 09:44:07.077149 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 437/887] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:06 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:08.092721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:08.093320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:08.099783 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:08.100222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:08.100964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:08.101390 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:08.234500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:08.241915 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0506798f-ff55-453e-9823-2599dd890b71 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.153184 Jul 20 09:44:08.242470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 451/888] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:08 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:09.258952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:09.259584 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:09.262406 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:09.267684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:09.268127 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:09.268881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:09.269312 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:09.546453 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:09.553794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-098aeae0-951c-42de-b61f-00b3458d2918 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.298672 Jul 20 09:44:09.554333 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 438/889] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:09 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:10.569970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:10.570576 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:10.573132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:10.573830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:10.580364 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:10.580809 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:10.581573 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:10.582007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:10.712590 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:10.721193 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-96bd0ff1-bb5d-4c67-8947-7e84d3b1fc32 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.155029 Jul 20 09:44:10.721794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 452/890] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:10 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:11.738193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:11.738812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:11.745832 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:11.746280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:11.747036 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:11.747500 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:11.881819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:11.889498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fe4d8c7f-c718-44ce-95bd-638868041418 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.155474 Jul 20 09:44:11.890055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 439/891] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:11 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:12.267195 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-f679b4df-0683-45da-80a2-8df519f9123d req-60a616dd-a5bc-47cd-ae4a-f34dc7004b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb063d3-178c-44c1-bc45-828171804bff", "name": "network-vif-plugged", "status": "completed", "tag": "e293b286-c896-48c7-b609-1a4f9bd4117a"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:12.279536 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-f679b4df-0683-45da-80a2-8df519f9123d req-60a616dd-a5bc-47cd-ae4a-f34dc7004b3f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:12.280063 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-f679b4df-0683-45da-80a2-8df519f9123d req-60a616dd-a5bc-47cd-ae4a-f34dc7004b3f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:12.291684 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-f679b4df-0683-45da-80a2-8df519f9123d req-60a616dd-a5bc-47cd-ae4a-f34dc7004b3f service nova] Creating event network-vif-plugged:e293b286-c896-48c7-b609-1a4f9bd4117a for instance acb063d3-178c-44c1-bc45-828171804bff on hv-cinder-82282 Jul 20 09:44:12.296667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-f679b4df-0683-45da-80a2-8df519f9123d req-60a616dd-a5bc-47cd-ae4a-f34dc7004b3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Jul 20 09:44:12.297178 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 453/892] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:12.906061 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:12.906664 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:12.913086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:12.913531 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:12.914535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:12.914968 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:13.048493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:13.055839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6bc2a2fb-2741-4e1f-8173-7bc422109552 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.153617 Jul 20 09:44:13.056395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 440/893] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:12 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:14.078987 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:14.079814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:14.086054 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:14.086496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:14.087251 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:14.087705 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:14.231071 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:14.238557 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-04856c18-cd20-4a1f-8c6c-66e41213ce07 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1266 microversion: 2.1 time: 0.166896 Jul 20 09:44:14.239122 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 454/894] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:14 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:15.256379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:15.257004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:15.264110 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:15.264551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:15.265316 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:15.265787 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:15.399425 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:15.407928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1e5719a0-cf55-417e-a352-f90db119716d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1453 microversion: 2.1 time: 0.155992 Jul 20 09:44:15.408485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 441/895] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:15 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:15.424614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:15.425320 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:15.431765 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:15.432220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:15.433118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:15.433552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:15.577672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:15.587740 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f6460719-e404-498e-93f2-74451d9ea585 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1453 microversion: 2.1 time: 0.167078 Jul 20 09:44:15.588845 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 455/896] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:15 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:17.354686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-69fafcf6-1de9-4617-bf53-a11de419bb16 req-be7b3e32-5047-4d8d-ae7a-9685ac08ed6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb063d3-178c-44c1-bc45-828171804bff", "tag": "e293b286-c896-48c7-b609-1a4f9bd4117a"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:17.363180 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-69fafcf6-1de9-4617-bf53-a11de419bb16 req-be7b3e32-5047-4d8d-ae7a-9685ac08ed6b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:17.363662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-69fafcf6-1de9-4617-bf53-a11de419bb16 req-be7b3e32-5047-4d8d-ae7a-9685ac08ed6b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:17.375476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-69fafcf6-1de9-4617-bf53-a11de419bb16 req-be7b3e32-5047-4d8d-ae7a-9685ac08ed6b service nova] Creating event network-changed:e293b286-c896-48c7-b609-1a4f9bd4117a for instance acb063d3-178c-44c1-bc45-828171804bff on hv-cinder-82282 Jul 20 09:44:17.380428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-69fafcf6-1de9-4617-bf53-a11de419bb16 req-be7b3e32-5047-4d8d-ae7a-9685ac08ed6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030118 Jul 20 09:44:17.381204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 442/897] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:21.545782 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:21.546303 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:21.552610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:21.553062 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:21.553818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:21.554277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:21.579388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6342da4f-9699-4ef8-bea0-cd6b50e7b4f8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/ips" status: 200 len: 151 microversion: 2.1 time: 0.037501 Jul 20 09:44:21.579952 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 456/898] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:44:21 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:22.920336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c38f27-e729-48a4-8bbd-e939f3f6c88f"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:22.921466 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:22.927747 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:22.928182 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:22.929002 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:22.929427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:23.159204 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-971be0c4-fda4-4a39-b7bc-9f5ba8a2a905 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244511 Jul 20 09:44:23.159835 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 443/899] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:44:22 2022] POST /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:30.655806 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5197f698-e80e-4a87-a18b-e12f7dfa8a5a tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: .version_select at 0x7f81f42b24c0>, body: {"keypair": {"name": "tempest-keypair-551794063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6nYPtacyvB1bO4J+C1TTPmesMlpNGbsQgBHTjxtwSWM9WpmuJFjrRKfhJIO/jAhGYOaWR6kvKk5DjgDp3V4/Ez9dwhCOzgwNj7HMvhtnJd0V4TQdGlxPjLnA8U/r4TCw=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:30.660306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:30.673058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-5197f698-e80e-4a87-a18b-e12f7dfa8a5a tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:44:30.676847 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-5197f698-e80e-4a87-a18b-e12f7dfa8a5a tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:44:30.699428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5197f698-e80e-4a87-a18b-e12f7dfa8a5a tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047331 Jul 20 09:44:30.699957 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 457/900] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:44:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:32.225498 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-124081171", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6671a0fd-e3f4-4bae-a778-86d0bc616f5d"}], "security_groups": [{"name": "tempest-securitygroup--288433555"}], "key_name": "tempest-keypair-551794063", "user_data": "}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:32.232078 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=25 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:32.328078 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] validate_networks() for [('6671a0fd-e3f4-4bae-a778-86d0bc616f5d', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:44:32.690768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:44:32.691186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:44:32.691676 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:44:32.692084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:44:32.692488 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:44:32.702131 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:32.702573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:32.703392 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:32.703820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:32.710286 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:32.722662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:44:32.726815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:44:32.737994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:44:32.740337 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:44:32.790057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8b0347da-3a32-477a-b651-4f122002c8d5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569753 Jul 20 09:44:32.790691 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 444/901] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:44:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:44:32.798175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=52 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:32.802798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2be1fcac-8021-4f7d-92b3-29dfd1beba78 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:32.803653 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2be1fcac-8021-4f7d-92b3-29dfd1beba78 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:32.862679 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2be1fcac-8021-4f7d-92b3-29dfd1beba78 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:32.870006 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2be1fcac-8021-4f7d-92b3-29dfd1beba78 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1240 microversion: 2.1 time: 0.072038 Jul 20 09:44:32.870786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 458/902] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:32 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:33.888845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:33.890119 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:33.897391 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:33.897864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:33.898648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:33.899472 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:33.974641 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:33.982227 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d333f8c8-5bf8-4f63-af31-a6b6510c4a12 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1298 microversion: 2.1 time: 0.099627 Jul 20 09:44:33.982786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 445/903] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:33 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:44:34.999149 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:35.004138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:35.012174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:35.012932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:35.013808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:35.014248 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:35.160208 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:35.169960 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-62a3f6bc-d2ad-425c-a4e5-ecd05d68f128 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.174573 Jul 20 09:44:35.178289 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 459/904] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:34 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:35.216377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-ad431f1c-2970-4ee2-85ca-e340c19e7098 req-e59e3c82-357c-4e76-a852-457a80f456b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222645e9-a074-436a-b823-1e91a831e7ef", "tag": "4ad74243-049d-4a2f-92b4-f2a502ec0c28"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:35.229037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-ad431f1c-2970-4ee2-85ca-e340c19e7098 req-e59e3c82-357c-4e76-a852-457a80f456b0 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:35.229493 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-ad431f1c-2970-4ee2-85ca-e340c19e7098 req-e59e3c82-357c-4e76-a852-457a80f456b0 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:35.245370 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-ad431f1c-2970-4ee2-85ca-e340c19e7098 req-e59e3c82-357c-4e76-a852-457a80f456b0 service nova] Creating event network-changed:4ad74243-049d-4a2f-92b4-f2a502ec0c28 for instance 222645e9-a074-436a-b823-1e91a831e7ef on hv-cinder-82282 Jul 20 09:44:35.250514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-ad431f1c-2970-4ee2-85ca-e340c19e7098 req-e59e3c82-357c-4e76-a852-457a80f456b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038677 Jul 20 09:44:35.251128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 446/905] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:36.186666 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:36.187276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:36.193741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:36.194187 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:36.194949 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:36.195416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:36.327873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:36.335186 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b21a4fa4-7ce7-47e3-b76e-3266e1700e34 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.152581 Jul 20 09:44:36.335794 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 460/906] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:36 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:37.353059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:37.353727 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:37.359975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:37.360418 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:37.361171 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:37.361601 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:37.494562 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:37.501868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7c5af72e-e180-4fbe-8651-261466761457 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.153540 Jul 20 09:44:37.502424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 447/907] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:37 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:38.519306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:38.519936 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:38.526846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:38.527279 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:38.528049 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:38.528478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:38.661211 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:38.669562 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-223df193-fcf1-4505-92d0-79f3d1777845 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.154260 Jul 20 09:44:38.670124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 461/908] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:38 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:39.686960 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:39.687579 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:39.693956 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:39.694394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:39.695137 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:39.695581 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:39.827136 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:39.834591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c212caa4-9328-474c-97dd-88f5b9663761 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.151483 Jul 20 09:44:39.835140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 448/909] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:39 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:40.433415 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-dd5b2189-2d53-4323-9bd7-ae5e0b266360 req-65edabd2-9bc5-429f-a30b-6863ad737df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222645e9-a074-436a-b823-1e91a831e7ef", "name": "network-vif-plugged", "status": "completed", "tag": "4ad74243-049d-4a2f-92b4-f2a502ec0c28"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:40.442566 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-dd5b2189-2d53-4323-9bd7-ae5e0b266360 req-65edabd2-9bc5-429f-a30b-6863ad737df2 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:40.442883 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-dd5b2189-2d53-4323-9bd7-ae5e0b266360 req-65edabd2-9bc5-429f-a30b-6863ad737df2 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:40.454875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-dd5b2189-2d53-4323-9bd7-ae5e0b266360 req-65edabd2-9bc5-429f-a30b-6863ad737df2 service nova] Creating event network-vif-plugged:4ad74243-049d-4a2f-92b4-f2a502ec0c28 for instance 222645e9-a074-436a-b823-1e91a831e7ef on hv-cinder-82282 Jul 20 09:44:40.459732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-dd5b2189-2d53-4323-9bd7-ae5e0b266360 req-65edabd2-9bc5-429f-a30b-6863ad737df2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030107 Jul 20 09:44:40.460344 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 462/910] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:40.852163 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:40.852705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:40.859041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:40.859505 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:40.860276 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:40.860694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:40.991839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:40.999858 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a8de79fb-5d01-4926-b980-8918525eb8e3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.151738 Jul 20 09:44:41.000405 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 449/911] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:40 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:42.017667 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:42.018352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:42.024537 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:42.024976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:42.026342 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:42.026762 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:42.157421 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:42.164722 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-37d49229-48ed-42cd-8477-4c870ae89163 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1365 microversion: 2.1 time: 0.151716 Jul 20 09:44:42.165540 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 463/912] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:42 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:43.181612 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:43.182173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:43.184589 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:43.185249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:43.191076 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:43.191547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:43.192299 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:43.192731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:43.322593 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:43.330398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6e12e6be-8ddd-45d8-b201-b2f569dcc739 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1556 microversion: 2.1 time: 0.152707 Jul 20 09:44:43.330967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 450/913] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:43 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:43.347350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:43.347909 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:43.349869 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:43.356074 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:43.356514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:43.357258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:43.357682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:43.433747 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-37296d99-cf68-43fb-a6e5-408d1d8cc7fc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090166 Jul 20 09:44:43.438028 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 464/914] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:44:43 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:44.367056 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-b5ca6079-300b-4f8a-b9eb-799d84750329 req-44e663ad-900c-4040-b8b3-3e8b6cce6980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222645e9-a074-436a-b823-1e91a831e7ef", "tag": "4ad74243-049d-4a2f-92b4-f2a502ec0c28"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:44.375711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b5ca6079-300b-4f8a-b9eb-799d84750329 req-44e663ad-900c-4040-b8b3-3e8b6cce6980 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:44.376266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b5ca6079-300b-4f8a-b9eb-799d84750329 req-44e663ad-900c-4040-b8b3-3e8b6cce6980 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:44.389514 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-b5ca6079-300b-4f8a-b9eb-799d84750329 req-44e663ad-900c-4040-b8b3-3e8b6cce6980 service nova] Creating event network-changed:4ad74243-049d-4a2f-92b4-f2a502ec0c28 for instance 222645e9-a074-436a-b823-1e91a831e7ef on hv-cinder-82282 Jul 20 09:44:44.394471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-b5ca6079-300b-4f8a-b9eb-799d84750329 req-44e663ad-900c-4040-b8b3-3e8b6cce6980 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031154 Jul 20 09:44:44.395263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 451/915] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:44:57.941752 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:57.942543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=30 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:57.946797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:44:57.947330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:57.954803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:57.955238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:57.956002 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:57.956426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:57.981618 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.objects.instance [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lazy-loading 'flavor' on Instance uuid 11204e32-acb1-4e5d-ab38-0c9f0ded5172 {{(pid=124373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:44:58.051238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-bf729d2c-ce5c-4e8c-8f55-fec37e98e7e2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "POST /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172/action" status: 202 len: 0 microversion: 2.1 time: 0.110516 Jul 20 09:44:58.051824 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 465/916] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:44:57 2022] POST /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:44:58.057798 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:58.058715 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=35 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:44:58.062580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:58.063270 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:58.071141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:58.071607 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:58.072387 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:58.072820 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:58.213196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:58.221398 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-aaf0a198-f18c-4df0-b7af-a0034294c7cb tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.165135 Jul 20 09:44:58.221952 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 452/917] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:58 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:44:59.239335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:44:59.240044 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:44:59.247406 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:59.247855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:59.248614 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:44:59.249046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:44:59.380316 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:44:59.388090 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f02598d3-02c5-4eed-b9c7-0504261bccc1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.153250 Jul 20 09:44:59.388659 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 466/918] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:44:59 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:00.404663 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:00.405245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:00.411791 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:00.412237 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:00.412999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:00.413427 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:00.541744 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:00.549739 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4fa24080-b35e-4284-aad3-22487bce0a62 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.149059 Jul 20 09:45:00.550294 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 453/919] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:00 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:01.567446 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:01.568067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:01.575864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:01.576310 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:01.577072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:01.577507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:01.707669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:01.715220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-135917dd-45cd-45d0-81b3-813a4cbceffa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.151713 Jul 20 09:45:01.715808 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 467/920] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:01 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:02.732025 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:02.732615 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:02.738966 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:02.739441 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:02.740187 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:02.740612 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:02.867618 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:02.874988 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-835d5b66-29e6-4362-bf50-a2bb6673bb1c tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.146899 Jul 20 09:45:02.875571 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 454/921] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:02 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:03.891013 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:03.891652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:03.898156 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:03.898579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:03.899353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:03.899787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:04.032508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:04.040220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ccdeacf0-2f6d-4385-9030-e3df8fb136fc tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.153133 Jul 20 09:45:04.041057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 468/922] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:03 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:05.058443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:05.059051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:05.065463 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:05.065907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:05.066665 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:05.067096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:05.198750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:05.206290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b00be59f-4208-40a9-8525-4ff6a44f2ce7 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.152301 Jul 20 09:45:05.206854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 455/923] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:05 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:06.224267 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:06.224875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:06.231441 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:06.231893 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:06.232655 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:06.233086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:06.372565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:06.380092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f6680afe-aea8-4c3b-8a8f-56537281382a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.160673 Jul 20 09:45:06.380657 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 469/924] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:06 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:07.397708 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:07.398315 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:07.405437 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:07.405881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:07.406634 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:07.407066 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:07.536046 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:07.543689 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-76f17c87-2436-4d53-be52-9cd6a7b89467 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.149947 Jul 20 09:45:07.544255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 456/925] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:07 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:08.561258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:08.561868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:08.568596 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:08.569041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:08.569875 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:08.570426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:08.706741 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:08.714389 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-749caebe-5cfe-4daa-a23c-844c7f3ad917 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.157716 Jul 20 09:45:08.715079 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 470/926] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:08 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:09.732969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:09.733580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:09.740105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:09.740547 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:09.741297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:09.741727 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:09.876543 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:09.883937 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f61d80bb-da06-45eb-9fb9-c92e1f1732b5 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.154870 Jul 20 09:45:09.884506 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 457/927] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:09 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:10.901410 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:10.902380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:10.909190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:10.909629 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:10.910376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:10.910801 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:11.043037 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:11.050598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-eba0de3d-696d-44ca-8d9a-e5b8fcb4c100 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1570 microversion: 2.1 time: 0.153560 Jul 20 09:45:11.051165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 471/928] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:10 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:11.066881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:11.067479 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:11.073822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:11.074975 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:11.075843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:11.076272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:11.155477 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5e3d7ed2-4cb2-4819-ae59-c1d770dba411 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "POST /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172/action" status: 202 len: 0 microversion: 2.1 time: 0.092355 Jul 20 09:45:11.156085 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 458/929] 10.222.0.18 () {60 vars in 1277 bytes} [Wed Jul 20 09:45:11 2022] POST /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:45:11.164263 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:11.164892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:11.171333 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:11.171784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:11.172543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:11.172975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:11.313732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:11.321565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9e534263-9f77-4d80-83e5-b7ed6dcc4556 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1518 microversion: 2.1 time: 0.161095 Jul 20 09:45:11.322221 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 472/930] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:11 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:12.342079 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:12.342625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:12.348684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:12.349128 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:12.349908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:12.350351 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:12.490812 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:12.498655 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7e4e135b-cd1b-470c-acd0-f9648115ad6a tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1520 microversion: 2.1 time: 0.162560 Jul 20 09:45:12.499209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 459/931] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:12 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:13.516206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:13.516929 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:13.523423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:13.523873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:13.524646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:13.525081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:13.659528 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:13.667214 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9ced552a-7519-4207-8ce0-1e1f5945f759 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.154968 Jul 20 09:45:13.667835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 473/932] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:13 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:14.562272 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-cffb0352-4b2c-4876-a31f-633cd66411b7 req-5d92c755-de7c-4822-a07d-d9e324341bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "name": "network-vif-unplugged", "status": "completed", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:14.571134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-cffb0352-4b2c-4876-a31f-633cd66411b7 req-5d92c755-de7c-4822-a07d-d9e324341bc7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:14.571542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-cffb0352-4b2c-4876-a31f-633cd66411b7 req-5d92c755-de7c-4822-a07d-d9e324341bc7 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:14.583229 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-cffb0352-4b2c-4876-a31f-633cd66411b7 req-5d92c755-de7c-4822-a07d-d9e324341bc7 service nova] Creating event network-vif-unplugged:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:45:14.588130 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-cffb0352-4b2c-4876-a31f-633cd66411b7 req-5d92c755-de7c-4822-a07d-d9e324341bc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030195 Jul 20 09:45:14.588720 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 460/933] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:14.685698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:14.686305 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:14.692672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:14.693113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:14.693905 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:14.694280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:14.826623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:14.834057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-daece726-e1c4-41b3-9e7e-deeb310b2a06 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.153304 Jul 20 09:45:14.834617 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 474/934] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:14 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:15.852185 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:15.852870 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:15.859592 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:15.860029 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:15.860797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:15.861222 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:15.992443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:15.999900 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-29039518-f52f-48c5-b553-e074879b06f1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.152442 Jul 20 09:45:16.000459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 461/935] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:15 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:17.016107 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:17.016708 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:17.023056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:17.023529 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:17.024274 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:17.024700 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:17.154838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:17.162200 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-977bae00-e4f8-4baa-b0bd-696287c20927 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.149902 Jul 20 09:45:17.162760 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 475/936] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:17 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:18.180203 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:18.180834 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:18.187901 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:18.188341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:18.189080 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:18.189504 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:18.317197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:18.325207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-a267cf19-cd64-4c93-bdda-4b110e1e4257 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.148848 Jul 20 09:45:18.325768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 462/937] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:18 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:19.343244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:19.344094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:19.350805 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:19.351253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:19.352042 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:19.352478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:19.494508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:19.504288 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ce07371b-cd91-47b1-9881-a4d1a5f812e1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.165123 Jul 20 09:45:19.505190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 476/938] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:19 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:20.391987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:20.392572 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:20.398542 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.398990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.399802 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.400206 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.423683 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-0d03eadc-0aa5-4bb1-87c8-105f718003a4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/ips" status: 200 len: 151 microversion: 2.1 time: 0.035618 Jul 20 09:45:20.424246 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 463/939] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:45:20 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:20.435554 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c38f27-e729-48a4-8bbd-e939f3f6c88f"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:20.436691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:20.443646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.444123 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.444889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.445319 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.523961 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: POST /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/os-volume_attachments HTTP/1.1 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 74 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:45:20.525768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {"volumeAttachment": {"volumeId": "26c38f27-e729-48a4-8bbd-e939f3f6c88f"}} Jul 20 09:45:20.527542 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'server_id': '222645e9-a074-436a-b823-1e91a831e7ef', 'body': {'volumeAttachment': {'volumeId': '26c38f27-e729-48a4-8bbd-e939f3f6c88f'}}} Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:45:20.528395 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:20.529734 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 400 to user: Invalid volume: volume 26c38f27-e729-48a4-8bbd-e939f3f6c88f is already attached to instances: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-64a6b92c-dc94-4875-888f-7a6cfd8ecc2d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096470 Jul 20 09:45:20.531162 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 477/940] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:45:20 2022] POST /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:45:20.531790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:20.531790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:20.535705 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.535883 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:20.536146 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.536380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:20.536903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.537332 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.543683 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.544131 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.544946 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.545379 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.570496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:45:20.599485 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:20.650825 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8df8f6e0-2951-44fc-afbf-3fda932cfdf0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 204 len: 0 microversion: 2.1 time: 0.118273 Jul 20 09:45:20.651776 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 478/941] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:45:20 2022] DELETE /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:45:20.662205 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:20.663225 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:20.670275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.670724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.671545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:20.671984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:20.676846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:20.685053 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3483f340-e225-44fc-96b1-2ca1d49082c6 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.160677 Jul 20 09:45:20.685808 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 464/942] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:20 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:20.804784 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:20.812798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c4d38f12-4344-47cb-9dd7-775f41b2e7b9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1681 microversion: 2.1 time: 0.155903 Jul 20 09:45:20.813352 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 479/943] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:20 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:21.702569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:21.703172 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:21.709644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:21.710081 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:21.710828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:21.711257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:21.830493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:21.831097 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:21.837610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:21.838060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:21.838816 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:21.839245 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:21.846245 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:21.853854 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6b09ae48-1600-4158-a9b6-a0498c1d6338 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1576 microversion: 2.1 time: 0.155773 Jul 20 09:45:21.857657 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 465/944] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:21 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:21.971605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:21.979004 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-e67b9fff-6974-4bab-920e-2a36caa9317d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1681 microversion: 2.1 time: 0.152400 Jul 20 09:45:21.979600 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 480/945] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:21 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:22.872414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:22.873458 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:22.881193 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:22.881732 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:22.882839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:22.883400 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:22.997350 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:22.998157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:23.004959 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:23.005504 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:23.006375 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:23.006876 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:23.159957 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:23.170787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-694eb4c4-e484-4121-b5c7-c738bab8e214 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1681 microversion: 2.1 time: 0.177603 Jul 20 09:45:23.172243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 481/946] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:22 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:23.197652 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:23.206051 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-77fb393a-db24-4c47-b9ed-44f56d841be1 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1563 microversion: 2.1 time: 0.338210 Jul 20 09:45:23.206624 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 466/947] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:22 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1563 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:23.764511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-5fe98a21-2160-40b3-b867-1e28f1ae2606 req-fda92b13-bdc0-4fe5-9057-aef0a348487f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222645e9-a074-436a-b823-1e91a831e7ef", "name": "network-vif-deleted", "tag": "4ad74243-049d-4a2f-92b4-f2a502ec0c28"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:23.774538 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-5fe98a21-2160-40b3-b867-1e28f1ae2606 req-fda92b13-bdc0-4fe5-9057-aef0a348487f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:23.775232 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-5fe98a21-2160-40b3-b867-1e28f1ae2606 req-fda92b13-bdc0-4fe5-9057-aef0a348487f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:23.788544 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-5fe98a21-2160-40b3-b867-1e28f1ae2606 req-fda92b13-bdc0-4fe5-9057-aef0a348487f service nova] Creating event network-vif-deleted:4ad74243-049d-4a2f-92b4-f2a502ec0c28 for instance 222645e9-a074-436a-b823-1e91a831e7ef on hv-cinder-82282 Jul 20 09:45:23.795000 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-5fe98a21-2160-40b3-b867-1e28f1ae2606 req-fda92b13-bdc0-4fe5-9057-aef0a348487f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Jul 20 09:45:23.796134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 482/948] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:24.189852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:24.190595 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:24.197626 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:24.198073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:24.198841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:24.199267 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:24.239967 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:24.240415 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:24.240898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lazy-loading 'fault' on Instance uuid 222645e9-a074-436a-b823-1e91a831e7ef {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:45:24.282840 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:24.290070 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f5f9c2f0-30b8-4b26-aef7-fd791575e743 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 200 len: 1330 microversion: 2.1 time: 0.104130 Jul 20 09:45:24.290636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 467/949] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:24 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:24.664670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-cf9287c2-6bbb-482d-9409-56abd000edf8 req-4aa3fdf3-1776-4bee-96e2-2fad9068d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "name": "network-vif-plugged", "status": "completed", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:24.676229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-cf9287c2-6bbb-482d-9409-56abd000edf8 req-4aa3fdf3-1776-4bee-96e2-2fad9068d8d0 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:24.677177 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-cf9287c2-6bbb-482d-9409-56abd000edf8 req-4aa3fdf3-1776-4bee-96e2-2fad9068d8d0 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:24.689907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-cf9287c2-6bbb-482d-9409-56abd000edf8 req-4aa3fdf3-1776-4bee-96e2-2fad9068d8d0 service nova] Creating event network-vif-plugged:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:45:24.695141 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-cf9287c2-6bbb-482d-9409-56abd000edf8 req-4aa3fdf3-1776-4bee-96e2-2fad9068d8d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034387 Jul 20 09:45:24.696047 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 483/950] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:25.308013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:25.308620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:25.315149 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:25.315629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:25.316377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:25.316806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:25.320822 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:25.332767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef HTTP/1.1 Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:45:25.334446 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:45:25.336095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '222645e9-a074-436a-b823-1e91a831e7ef'} Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:45:25.336963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:45:25.338492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:25.339912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:45:25.339912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7b4e7c1c-f9af-46ea-abb1-829fdb0f0a5f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 404 len: 111 microversion: 2.1 time: 0.031795 Jul 20 09:45:25.339912 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 468/951] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:25 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:45:25.346048 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c0977533-4d77-4bf4-8710-9d7351d6a431 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '.version_select at 0x7f81f41f1310>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:25.362565 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c0977533-4d77-4bf4-8710-9d7351d6a431 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551794063" status: 202 len: 0 microversion: 2.1 time: 0.021461 Jul 20 09:45:25.363112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 484/952] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jul 20 09:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551794063 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:45:26.229928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:26.230414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:26.238445 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:26.238881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:26.239659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:26.240112 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:26.321339 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lazy-loading 'services' on Instance uuid ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:45:26.392408 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eedcae54-3f58-4318-9de1-08392ff034c3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments/26c38f27-e729-48a4-8bbd-e939f3f6c88f" status: 202 len: 0 microversion: 2.1 time: 0.166172 Jul 20 09:45:26.393207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 469/953] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:45:26 2022] DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments/26c38f27-e729-48a4-8bbd-e939f3f6c88f => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:45:26.402299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:26.403472 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:26.410364 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:26.410804 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:26.411578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:26.412006 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:26.445070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-73ca3632-dc04-4bb3-abda-08c2348f27fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Jul 20 09:45:26.445641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 485/954] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:45:26 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:27.457985 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:27.459050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:27.465682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.466972 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.467786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.468241 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.496361 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9c9b0639-b47c-402a-a299-cac181cf53c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042659 Jul 20 09:45:27.496899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 470/955] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:45:27 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:45:27.553570 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:27.554108 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:27.560849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.561295 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.562046 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.562477 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.589455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:45:27.662432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-60beb444-26a7-4164-b3b1-4333102561fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 204 len: 0 microversion: 2.1 time: 0.112193 Jul 20 09:45:27.662803 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 486/956] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:45:27 2022] DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:45:27.671939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:27.672583 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:27.678451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.678896 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.679682 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:27.680110 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:27.819653 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:27.827994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6d58c9d2-2268-4aec-930b-3627df51aa91 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1683 microversion: 2.1 time: 0.160677 Jul 20 09:45:27.828749 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 471/957] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:27 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:28.846786 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:28.847500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:28.849814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:28.855308 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:28.855766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:28.856508 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:28.858188 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:28.988818 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:28.996307 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-b5aa5f77-edb0-41f1-ae6e-0e1c06d33287 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1683 microversion: 2.1 time: 0.154783 Jul 20 09:45:28.996877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 487/958] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:28 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:30.003766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-b3762268-4dfd-49b4-a73d-4017038912eb req-e6805897-3b94-44d0-8f67-f1e74d41c37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac77738b-4bd2-4a70-b5f1-50f154fbf3f1", "name": "network-vif-deleted", "tag": "c2e36cbd-e333-4f09-b744-1b79cceb1f5f"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:30.007839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=45 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:30.014225 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b3762268-4dfd-49b4-a73d-4017038912eb req-e6805897-3b94-44d0-8f67-f1e74d41c37a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:30.014666 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-b3762268-4dfd-49b4-a73d-4017038912eb req-e6805897-3b94-44d0-8f67-f1e74d41c37a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:30.018026 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:30.019265 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:30.026506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:30.027255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-b3762268-4dfd-49b4-a73d-4017038912eb req-e6805897-3b94-44d0-8f67-f1e74d41c37a service nova] Creating event network-vif-deleted:c2e36cbd-e333-4f09-b744-1b79cceb1f5f for instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 on hv-cinder-82282 Jul 20 09:45:30.027975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:30.029877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:30.031452 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:30.033254 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-b3762268-4dfd-49b4-a73d-4017038912eb req-e6805897-3b94-44d0-8f67-f1e74d41c37a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033250 Jul 20 09:45:30.033857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 472/959] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:30.105792 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:30.116465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8795db27-455e-4c9c-b9de-53ce3d6066dd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 200 len: 1326 microversion: 2.1 time: 0.106048 Jul 20 09:45:30.117088 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 488/960] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:30 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:31.135065 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:31.135789 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:31.142194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:31.142633 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:31.143406 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:31.143837 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:31.158947 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 HTTP/1.1 Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:45:31.160590 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:45:31.162207 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'ac77738b-4bd2-4a70-b5f1-50f154fbf3f1'} Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:45:31.163151 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:45:31.164693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:45:31.166517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:45:31.166517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-68ae9310-365a-44e0-9753-a044567d1331 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 404 len: 111 microversion: 2.1 time: 0.031752 Jul 20 09:45:31.166517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 473/961] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:31 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:45:31.171672 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-459fbc89-97cd-4a69-b055-5c4ff6355ab8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '.version_select at 0x7f81f447e4c0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:31.188988 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-459fbc89-97cd-4a69-b055-5c4ff6355ab8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987997939" status: 202 len: 0 microversion: 2.1 time: 0.021783 Jul 20 09:45:31.189539 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 489/962] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jul 20 09:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987997939 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:45:31.802733 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5e4c6126-4176-49f0-bbc1-1290922a1f20 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: .version_select at 0x7f81f4454dc0>, body: {"keypair": {"name": "tempest-keypair-1611537061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLS0Cx+1iYpgkaFVqXcyG3fLVE/oR1ug/aWunElZ7woRq8pWz58M6VZxd4VRMBfkdBTnbX4Y8BLFk4C7rwOqn1qTK3ki/GWg9wYDP06ZaiCC6uLlTSA6h6Y3nn5IduyzKQ=="}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:31.816535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-5e4c6126-4176-49f0-bbc1-1290922a1f20 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:45:31.820303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-5e4c6126-4176-49f0-bbc1-1290922a1f20 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:45:31.842129 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5e4c6126-4176-49f0-bbc1-1290922a1f20 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043297 Jul 20 09:45:31.843375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 474/963] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:45:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:33.058121 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441566480", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6671a0fd-e3f4-4bae-a778-86d0bc616f5d"}], "security_groups": [{"name": "tempest-securitygroup--1125807187"}], "key_name": "tempest-keypair-1611537061", "user_data": "}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:33.161411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] validate_networks() for [('6671a0fd-e3f4-4bae-a778-86d0bc616f5d', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:45:33.532083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:45:33.532507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:45:33.532975 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:45:33.533388 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:45:33.533805 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:45:33.542837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:33.543277 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:33.544091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:33.544521 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:33.560674 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:45:33.565100 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:45:33.575724 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:45:33.578575 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:45:33.626332 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7cfdfe80-3e7b-4406-8fb8-879495fd427b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572998 Jul 20 09:45:33.626987 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 490/964] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:45:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:45:33.637297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c5354307-0e16-494b-bf86-8cb1ebf8c020 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:33.637905 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c5354307-0e16-494b-bf86-8cb1ebf8c020 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:33.702644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-c5354307-0e16-494b-bf86-8cb1ebf8c020 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:33.716028 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c5354307-0e16-494b-bf86-8cb1ebf8c020 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1241 microversion: 2.1 time: 0.082626 Jul 20 09:45:33.717059 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 475/965] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:33 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:34.735641 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:34.736403 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:34.744187 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:34.744639 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:34.745407 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:34.745840 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:34.809081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:34.817066 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-317ea5b9-6346-473f-b7f8-bcff57d39359 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1299 microversion: 2.1 time: 0.086157 Jul 20 09:45:34.817841 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 491/966] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:34 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:35.835470 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:35.836839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:35.843804 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:35.844257 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:35.845036 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:35.845475 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:35.943031 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-31f7d15d-8b80-450b-a0f4-349d163ecbf3 req-2dc6aa52-fa39-48db-a4bc-792c57ac1a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3dce63-78c9-445f-8b86-bc9756df776c", "tag": "52fdf823-3ebd-41d7-ab74-a372859773e8"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:35.957754 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-31f7d15d-8b80-450b-a0f4-349d163ecbf3 req-2dc6aa52-fa39-48db-a4bc-792c57ac1a4c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:35.958275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-31f7d15d-8b80-450b-a0f4-349d163ecbf3 req-2dc6aa52-fa39-48db-a4bc-792c57ac1a4c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:35.973093 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-31f7d15d-8b80-450b-a0f4-349d163ecbf3 req-2dc6aa52-fa39-48db-a4bc-792c57ac1a4c service nova] Creating event network-changed:52fdf823-3ebd-41d7-ab74-a372859773e8 for instance ce3dce63-78c9-445f-8b86-bc9756df776c on hv-cinder-82282 Jul 20 09:45:35.978439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-31f7d15d-8b80-450b-a0f4-349d163ecbf3 req-2dc6aa52-fa39-48db-a4bc-792c57ac1a4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039014 Jul 20 09:45:35.979052 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 492/967] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:45:36.105692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:36.114083 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b17d8ef3-b0ab-485d-b991-2380eb617d7b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.282456 Jul 20 09:45:36.114745 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 476/968] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:35 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:45:37.131050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:37.131767 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:37.137953 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:37.138397 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:37.139145 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:37.139605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:37.274034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:37.281817 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-5469b11b-f2b6-41ed-9696-290cc62a8d24 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.155149 Jul 20 09:45:37.282215 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 493/969] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:37 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:38.298062 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:38.298696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:38.305213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:38.305662 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:38.306413 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:38.306850 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:38.435461 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:38.443137 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8c278214-3a0e-47e5-a2cd-6a57d7b19278 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.148899 Jul 20 09:45:38.443735 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 477/970] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:38 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:39.460134 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:39.460737 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:39.467262 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:39.467731 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:39.468471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:39.469399 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:39.598892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:39.606258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ea5a4cae-e9ef-4108-b445-4b30236f1fd8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.150058 Jul 20 09:45:39.606830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 494/971] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:39 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:40.623917 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:40.624520 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:40.631616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:40.632057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:40.632807 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:40.633255 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:40.769469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-3887a065-cd21-4409-8b41-dc1cfa96d610 req-8c2ea5ef-4b70-472f-b131-dfc3cbf197ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3dce63-78c9-445f-8b86-bc9756df776c", "name": "network-vif-plugged", "status": "completed", "tag": "52fdf823-3ebd-41d7-ab74-a372859773e8"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:40.778446 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-3887a065-cd21-4409-8b41-dc1cfa96d610 req-8c2ea5ef-4b70-472f-b131-dfc3cbf197ab service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:40.778997 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-3887a065-cd21-4409-8b41-dc1cfa96d610 req-8c2ea5ef-4b70-472f-b131-dfc3cbf197ab service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:40.780751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:40.790557 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-df567bee-e60e-4079-a6a6-297b0f0c1c3f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.170429 Jul 20 09:45:40.791619 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 478/972] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:40 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:40.795775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-3887a065-cd21-4409-8b41-dc1cfa96d610 req-8c2ea5ef-4b70-472f-b131-dfc3cbf197ab service nova] Creating event network-vif-plugged:52fdf823-3ebd-41d7-ab74-a372859773e8 for instance ce3dce63-78c9-445f-8b86-bc9756df776c on hv-cinder-82282 Jul 20 09:45:40.802835 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-3887a065-cd21-4409-8b41-dc1cfa96d610 req-8c2ea5ef-4b70-472f-b131-dfc3cbf197ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037213 Jul 20 09:45:40.803595 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 495/973] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:45:41.808013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:41.808618 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:41.815105 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:41.815587 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:41.816340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:41.816768 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:41.947343 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:41.955224 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3fe4603e-b7ce-4106-9bc3-94889d1dbd84 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1367 microversion: 2.1 time: 0.151172 Jul 20 09:45:41.955803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 479/974] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:41 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:42.972007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:42.972701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:42.978860 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:42.979330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:42.980086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:42.980516 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:43.109598 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:45:43.117468 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1338bdf2-2bd2-4912-86c8-692966702fc1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1558 microversion: 2.1 time: 0.150321 Jul 20 09:45:43.118238 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 496/975] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:45:42 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:45:43.133644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:45:43.134143 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:45:43.140585 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:43.141050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:43.141806 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:43.142235 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:43.217847 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f20c9714-998e-4ded-9086-a575b8975400 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088015 Jul 20 09:45:43.218473 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 480/976] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:45:43 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:45:44.408222 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-6b7c6832-9adf-438b-8b52-a87cc619be86 req-dc217c25-d12f-4f67-8fa1-6d95bda2e2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce3dce63-78c9-445f-8b86-bc9756df776c", "tag": "52fdf823-3ebd-41d7-ab74-a372859773e8"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:45:44.411797 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:44.412520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=6 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:45:44.419907 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-6b7c6832-9adf-438b-8b52-a87cc619be86 req-dc217c25-d12f-4f67-8fa1-6d95bda2e2b3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:45:44.420340 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-6b7c6832-9adf-438b-8b52-a87cc619be86 req-dc217c25-d12f-4f67-8fa1-6d95bda2e2b3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:45:44.431885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-6b7c6832-9adf-438b-8b52-a87cc619be86 req-dc217c25-d12f-4f67-8fa1-6d95bda2e2b3 service nova] Creating event network-changed:52fdf823-3ebd-41d7-ab74-a372859773e8 for instance ce3dce63-78c9-445f-8b86-bc9756df776c on hv-cinder-82282 Jul 20 09:45:44.436910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-6b7c6832-9adf-438b-8b52-a87cc619be86 req-dc217c25-d12f-4f67-8fa1-6d95bda2e2b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Jul 20 09:45:44.438838 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 497/977] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:14.759623 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:14.761092 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:14.761800 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:14.765864 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:14.766350 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:14.775317 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:14.775752 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:14.776507 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:14.776936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:14.806038 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:46:14.879577 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9013f14e-3228-48ce-9267-e66a5099c8b5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "DELETE /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 204 len: 0 microversion: 2.1 time: 0.120453 Jul 20 09:46:14.880220 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 481/978] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:46:14 2022] DELETE /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:46:14.888886 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:14.889578 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:14.891774 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:14.892509 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:14.899481 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:14.899924 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:14.900680 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:14.901112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:15.086039 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:15.093506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-55653c31-5f5e-4076-af9a-c68ed5e1e8e3 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1578 microversion: 2.1 time: 0.208824 Jul 20 09:46:15.094069 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 498/979] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:14 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:16.111089 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:16.111803 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:16.118951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:16.119428 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:16.120184 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:16.120613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:16.302685 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:16.310248 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-ffa1ac16-d18d-48c8-be56-fd754f182136 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1578 microversion: 2.1 time: 0.203441 Jul 20 09:46:16.310841 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 482/980] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:16 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:17.328427 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:17.329060 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:17.336697 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:17.337189 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:17.337940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:17.338943 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:17.418815 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-e629b3e4-ef72-41de-8793-f8f846cc44c5 req-2b7c6e0c-fe8e-4aec-8e31-07a64862f601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb063d3-178c-44c1-bc45-828171804bff", "name": "network-vif-deleted", "tag": "e293b286-c896-48c7-b609-1a4f9bd4117a"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:17.421737 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:17.430384 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-e629b3e4-ef72-41de-8793-f8f846cc44c5 req-2b7c6e0c-fe8e-4aec-8e31-07a64862f601 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:17.430826 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-e629b3e4-ef72-41de-8793-f8f846cc44c5 req-2b7c6e0c-fe8e-4aec-8e31-07a64862f601 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:17.431086 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0d5c1a65-e5f6-4662-937b-c2735cdef50c tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 200 len: 1510 microversion: 2.1 time: 0.106549 Jul 20 09:46:17.431701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 499/981] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:17 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:17.455963 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-e629b3e4-ef72-41de-8793-f8f846cc44c5 req-2b7c6e0c-fe8e-4aec-8e31-07a64862f601 service nova] Creating event network-vif-deleted:e293b286-c896-48c7-b609-1a4f9bd4117a for instance acb063d3-178c-44c1-bc45-828171804bff on hv-cinder-82282 Jul 20 09:46:17.461676 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-e629b3e4-ef72-41de-8793-f8f846cc44c5 req-2b7c6e0c-fe8e-4aec-8e31-07a64862f601 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047140 Jul 20 09:46:17.462969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 483/982] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:18.447976 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:18.448581 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: acb063d3-178c-44c1-bc45-828171804bff] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:18.454940 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:18.455407 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:18.456169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:18.457291 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:18.470353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] HTTP exception thrown: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Request method failure captured: Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff HTTP/1.1 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi185H0cJ8KX4rB-XRISKfCF6rePVuTKDqu2u2AoRegYz_e2DdLFad1p6JClRD3DIBkJDGlr_jWyfRzNg7rhBiG2OgBxK5rpGSDlFgWcO-RFpB2OgE8KRsd9m9CMimZocPU8yBrdbNJ_S_5xNmvzTpFEsVf3bP_RVAoRY773ZTAdAH7C0 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 42a88572ee8443d4a51617c04ca2f416 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-TestVolumeBootPattern-1928445346 Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:46:18.472103 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_42a88572ee8443d4a51617c04ca2f416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42a88572ee8443d4a51617c04ca2f416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/42a88572ee8443d4a51617c04ca2f416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/42a88572ee8443d4a51617c04ca2f416"}]}] Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-TestVolumeBootPattern-1928445346 Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 42a88572ee8443d4a51617c04ca2f416 Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-TestVolumeBootPattern-1928445346 Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-TestVolumeBootPattern-1928445346-project Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ac343929fc8542439bc627a1f445b1dd Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-TestVolumeBootPattern-1928445346-project Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. Jul 20 09:46:18.474174 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'acb063d3-178c-44c1-bc45-828171804bff'} Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:46:18.475146 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. Jul 20 09:46:18.476756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:18.478135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Returning 404 to user: Instance acb063d3-178c-44c1-bc45-828171804bff could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:46:18.478135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f86f7ff7-3fc0-4398-a126-5fd2412db91b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff" status: 404 len: 111 microversion: 2.1 time: 0.029648 Jul 20 09:46:18.478135 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 500/983] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:18 2022] GET /compute/v2.1/servers/acb063d3-178c-44c1-bc45-828171804bff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:46:18.521022 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-308993343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-926131090", "security_groups": [{"name": "tempest-secgroup-smoke-1069216155"}], "block_device_mapping_v2": [{"uuid": "474ea8ba-85ca-46c4-8014-012de0940cca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49ad933c-e19c-4fd1-95f5-c5db07071624"}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:18.635824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] validate_networks() for [('49ad933c-e19c-4fd1-95f5-c5db07071624', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:46:19.002096 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:46:19.002517 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:46:19.002987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:46:19.003534 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:46:19.003945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:46:19.012684 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:19.013120 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:19.013914 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:19.014342 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:19.030518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:46:19.034962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for user ac343929fc8542439bc627a1f445b1dd and project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:46:19.090761 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:46:19.092966 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='474ea8ba-85ca-46c4-8014-012de0940cca',volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:46:19.224070 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-1697316c-f334-491e-adda-05e01fccf6e7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708047 Jul 20 09:46:19.230040 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 484/984] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:46:19.235376 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7afa0760-cbd7-484f-9388-835dd8a467b4 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:19.235990 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7afa0760-cbd7-484f-9388-835dd8a467b4 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:19.299213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7afa0760-cbd7-484f-9388-835dd8a467b4 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:19.306006 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7afa0760-cbd7-484f-9388-835dd8a467b4 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1093 microversion: 2.1 time: 0.074673 Jul 20 09:46:19.306568 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 501/985] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:19 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:20.323987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:20.325860 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:20.335434 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:20.335881 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:20.336649 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:20.337078 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:20.431819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:20.439464 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8c1a2525-548c-48ce-bdcf-23da15ae8ebf tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1209 microversion: 2.1 time: 0.120483 Jul 20 09:46:20.440042 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 485/986] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:20 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:20.516381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:20.516964 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:20.524796 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:20.525299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:20.526091 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:20.526525 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:20.552444 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-799b448c-ea86-4495-b018-cf30fdbe59cd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/ips" status: 200 len: 151 microversion: 2.1 time: 0.039826 Jul 20 09:46:20.553059 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 502/987] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:46:20 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:21.458375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:21.459049 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:21.465762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:21.467340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:21.468213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:21.468723 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:21.657768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-e5d34342-bd93-426e-91cf-6498c32e2084 req-b8154657-d3d0-48a8-ade6-a9079581a778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95", "tag": "361144e0-fc56-4c8c-b382-29b23daf98dd"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:21.669407 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5d34342-bd93-426e-91cf-6498c32e2084 req-b8154657-d3d0-48a8-ade6-a9079581a778 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:21.670253 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-e5d34342-bd93-426e-91cf-6498c32e2084 req-b8154657-d3d0-48a8-ade6-a9079581a778 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:21.686935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-e5d34342-bd93-426e-91cf-6498c32e2084 req-b8154657-d3d0-48a8-ade6-a9079581a778 service nova] Creating event network-changed:361144e0-fc56-4c8c-b382-29b23daf98dd for instance 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 on hv-cinder-82282 Jul 20 09:46:21.692241 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:21.704969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9043d67f-5af4-408f-96c1-a9d6e98fcafd tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.251329 Jul 20 09:46:21.708086 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 486/988] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:21 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:21.709203 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-e5d34342-bd93-426e-91cf-6498c32e2084 req-b8154657-d3d0-48a8-ade6-a9079581a778 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055149 Jul 20 09:46:21.710321 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 503/989] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:21.926249 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8515579-6e1b-47b6-8826-419d74534032"}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:21.927696 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:21.933846 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:21.934389 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:21.935230 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:21.935766 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:22.174757 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-96290a1f-ff42-48ab-8b1d-2dc13c0745fb tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253056 Jul 20 09:46:22.175636 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 487/990] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:46:21 2022] POST /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:22.725229 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:22.725932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:22.733190 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:22.733707 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:22.734543 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:22.735044 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:22.871763 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:22.879372 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2be4f228-f4d3-4b7e-9f34-1bd93c009f8d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.159252 Jul 20 09:46:22.879941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 504/991] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:22 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:23.897340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:23.898020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:23.904137 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:23.904575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:23.905324 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:23.905750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:24.037015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:24.044648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3fa70bdf-888d-4352-b31b-6f15f04e1e98 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.152436 Jul 20 09:46:24.045209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 488/992] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:23 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:25.061830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:25.062462 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:25.069609 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:25.070075 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:25.071004 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:25.071514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:25.200022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:25.207882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-02bafd9a-224c-4206-8867-2cb39e747f95 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.149994 Jul 20 09:46:25.208437 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 505/993] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:25 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:26.225196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:26.225828 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:26.232298 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:26.232774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:26.233525 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:26.233951 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:26.364882 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:26.372268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-70825ea6-9003-462f-af9f-63b9e7947858 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.151648 Jul 20 09:46:26.372857 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 489/994] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:26 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:27.389478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:27.390087 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:27.396644 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:27.397094 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:27.397849 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:27.398282 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:27.536220 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:27.543932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-15f471a9-cc6a-4066-b156-fa85970583a9 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.158408 Jul 20 09:46:27.544496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 506/995] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:27 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:28.561431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:28.562065 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:28.569190 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:28.569638 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:28.570394 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:28.570830 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:28.978250 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:28.985797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7cca0298-65bc-4d05-80ee-3f6bf0341c1b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.428266 Jul 20 09:46:28.986387 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 490/996] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:28 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:29.655170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8515579-6e1b-47b6-8826-419d74534032"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:29.656252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:29.658652 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:29.664932 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.665381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:29.666143 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.666610 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:29.744691 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: POST /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments HTTP/1.1 Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 74 Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:46:29.746413 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {"volumeAttachment": {"volumeId": "f8515579-6e1b-47b6-8826-419d74534032"}} Jul 20 09:46:29.748126 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'server_id': 'ce3dce63-78c9-445f-8b86-bc9756df776c', 'body': {'volumeAttachment': {'volumeId': 'f8515579-6e1b-47b6-8826-419d74534032'}}} Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:29.749085 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:29.750625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 400 to user: Invalid volume: volume f8515579-6e1b-47b6-8826-419d74534032 is already attached to instances: ce3dce63-78c9-445f-8b86-bc9756df776c {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0dc29ef8-32b2-4d6f-9826-833fba9aad7e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096704 Jul 20 09:46:29.752465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 507/997] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:46:29 2022] POST /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:46:29.807928 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:29.808431 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:29.810297 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:29.810959 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:29.818115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.818548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:29.819306 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.819742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:29.900144 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lazy-loading 'services' on Instance uuid ce3dce63-78c9-445f-8b86-bc9756df776c {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:46:29.970640 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-eec04eed-5944-4305-a022-c7708ff7dd79 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments/f8515579-6e1b-47b6-8826-419d74534032" status: 202 len: 0 microversion: 2.1 time: 0.166250 Jul 20 09:46:29.971228 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 491/998] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:46:29 2022] DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments/f8515579-6e1b-47b6-8826-419d74534032 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:46:29.979599 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:29.980550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:29.986501 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.986986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:29.987848 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:29.988276 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:30.003492 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:30.004783 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:30.011794 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:30.012408 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:30.013159 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:30.014004 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:30.019490 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-be8f1e00-e93f-4181-b63e-d7a7cdd4241f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Jul 20 09:46:30.020715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 508/999] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:46:29 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:30.153894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:30.161929 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-2d1e1931-1640-48d5-aa3c-b29343f201dc tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.162794 Jul 20 09:46:30.162491 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 492/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:29 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:31.031952 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:31.032882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:31.040839 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.041287 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.042050 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.042481 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.070474 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9a7b6638-483d-4dad-8e8b-06fc74be5725 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042486 Jul 20 09:46:31.070955 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 509/1001] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:46:31 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:46:31.127936 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:31.128433 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:31.134805 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.135247 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.136022 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.136452 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.161900 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Going to try to terminate instance {{(pid=124374) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:46:31.177974 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:31.178592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:31.184613 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.185058 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.185814 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.186244 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.208987 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:31.256326 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-764ab78d-eefc-44a9-aa29-6567a47948cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 204 len: 0 microversion: 2.1 time: 0.131931 Jul 20 09:46:31.260375 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 493/1002] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:46:31 2022] DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:46:31.266535 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:31.267381 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:31.275591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.275749 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.276409 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:31.276836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:31.327451 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:31.337493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-647e5dff-ffd7-4c69-973e-44663ec15f29 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.163449 Jul 20 09:46:31.338081 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 510/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:31 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:31.423553 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:31.431536 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-3faf13bc-e382-45b3-b2c5-7dba7940b441 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1683 microversion: 2.1 time: 0.169715 Jul 20 09:46:31.432302 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 494/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:31 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:32.354726 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:32.355412 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:32.361951 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:32.362399 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:32.363157 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:32.364236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:32.448772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:32.449369 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:32.455852 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:32.456290 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:32.457037 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:32.458173 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:32.495339 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:32.503114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-f113c79c-3246-4eee-9653-1eb603cdb81b tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.152332 Jul 20 09:46:32.503710 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 511/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:32 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:32.586415 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:32.593955 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-dd8d602d-695f-4140-8e37-d2002f894f3d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1683 microversion: 2.1 time: 0.148981 Jul 20 09:46:32.594523 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 495/1006] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:32 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:32.970111 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-90b56c68-e7f6-4634-8fdb-709d323a9691 req-d1318c15-e091-4e04-a3f5-dba49c2be7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95", "name": "network-vif-plugged", "status": "completed", "tag": "361144e0-fc56-4c8c-b382-29b23daf98dd"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:32.980743 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-90b56c68-e7f6-4634-8fdb-709d323a9691 req-d1318c15-e091-4e04-a3f5-dba49c2be7d9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:32.981249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-90b56c68-e7f6-4634-8fdb-709d323a9691 req-d1318c15-e091-4e04-a3f5-dba49c2be7d9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:32.993901 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-90b56c68-e7f6-4634-8fdb-709d323a9691 req-d1318c15-e091-4e04-a3f5-dba49c2be7d9 service nova] Creating event network-vif-plugged:361144e0-fc56-4c8c-b382-29b23daf98dd for instance 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 on hv-cinder-82282 Jul 20 09:46:32.998919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-90b56c68-e7f6-4634-8fdb-709d323a9691 req-d1318c15-e091-4e04-a3f5-dba49c2be7d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Jul 20 09:46:32.999757 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 512/1007] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:33.519432 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:33.520675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:33.527138 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:33.527616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:33.528379 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:33.528839 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:33.612285 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:33.613028 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:33.628158 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:33.629968 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:33.630996 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:33.631524 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:33.717674 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:33.725695 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7c231bad-9214-42b2-96e6-6b7bf74f8e3b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1615 microversion: 2.1 time: 0.118026 Jul 20 09:46:33.726935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 513/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:33 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1615 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:33.739082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-885b4bd4-43b8-4e38-80da-397e50652337 req-0693a2d8-46b9-4b28-8243-dd07e19f84bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce3dce63-78c9-445f-8b86-bc9756df776c", "name": "network-vif-deleted", "tag": "52fdf823-3ebd-41d7-ab74-a372859773e8"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:33.739335 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:33.751619 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8e21b075-c929-4292-b1f3-f8e65a7c7bd7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1265 microversion: 2.1 time: 0.235970 Jul 20 09:46:33.752227 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 496/1009] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:33 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:33.752749 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-885b4bd4-43b8-4e38-80da-397e50652337 req-0693a2d8-46b9-4b28-8243-dd07e19f84bc service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:33.753470 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-885b4bd4-43b8-4e38-80da-397e50652337 req-0693a2d8-46b9-4b28-8243-dd07e19f84bc service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:33.768531 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-885b4bd4-43b8-4e38-80da-397e50652337 req-0693a2d8-46b9-4b28-8243-dd07e19f84bc service nova] Creating event network-vif-deleted:52fdf823-3ebd-41d7-ab74-a372859773e8 for instance ce3dce63-78c9-445f-8b86-bc9756df776c on hv-cinder-82282 Jul 20 09:46:33.776252 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-885b4bd4-43b8-4e38-80da-397e50652337 req-0693a2d8-46b9-4b28-8243-dd07e19f84bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047783 Jul 20 09:46:33.777067 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 514/1010] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:34.746613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:34.748007 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:34.757196 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.758055 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.758899 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.759562 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.771941 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:34.773669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:34.782095 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.782263 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.783124 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.783751 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.797165 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.797606 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.798073 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lazy-loading 'fault' on Instance uuid ce3dce63-78c9-445f-8b86-bc9756df776c {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:46:34.845265 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:34.854041 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6792dcc4-6e65-4fdd-bf93-a46f71fc9ec3 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 200 len: 1331 microversion: 2.1 time: 0.113745 Jul 20 09:46:34.854943 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 497/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:34 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:34.930115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:34.937843 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-94b7e762-3dfb-4b38-9a2c-675da32b47f5 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1452 microversion: 2.1 time: 0.171547 Jul 20 09:46:34.938411 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 515/1012] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:34 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:34.954014 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:34.954616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:34.961082 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.961539 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:34.962268 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:34.962693 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:35.090487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:35.098571 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-6110b718-89a2-4a8a-bf4f-2fd25a924c9e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95" status: 200 len: 1452 microversion: 2.1 time: 0.147761 Jul 20 09:46:35.099134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 498/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:34 2022] GET /compute/v2.1/servers/2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:35.872139 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:35.872720 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:35.879756 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:35.880206 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:35.881061 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:35.881500 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:35.895812 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c HTTP/1.1 Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:46:35.897493 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:46:35.899133 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'ce3dce63-78c9-445f-8b86-bc9756df776c'} Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:46:35.900073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:46:35.901513 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:35.903234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:46:35.903234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d62b112f-324a-4cf4-ab88-c6983b810965 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 404 len: 111 microversion: 2.1 time: 0.030801 Jul 20 09:46:35.903234 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 516/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:35 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:46:35.908591 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c5acdebd-464a-436a-9449-63eaef2b25a1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '.version_select at 0x7f81f8cc8c10>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:35.927218 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c5acdebd-464a-436a-9449-63eaef2b25a1 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611537061" status: 202 len: 0 microversion: 2.1 time: 0.022608 Jul 20 09:46:35.931140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 499/1015] 10.222.0.18 () {58 vars in 1220 bytes} [Wed Jul 20 09:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611537061 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:46:36.696199 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-3a2f4200-ebaf-4d51-93e8-8de93e67b14f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: .version_select at 0x7f81f45e4940>, body: {"keypair": {"name": "tempest-keypair-817668503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZmmpirDgilGkeecN/OGQ+nSQDYAh3Hpq6EHdVA1T+bx03faaomM5Dq2Jmy8XyhzSW05D8m7kpkrh9tBYvjeckeSXPHW2OWiE1qvrjX7rRpwGP2PcNuVF20AoDBUsV5IA=="}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:36.710016 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-3a2f4200-ebaf-4d51-93e8-8de93e67b14f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:46:36.713787 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-3a2f4200-ebaf-4d51-93e8-8de93e67b14f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'key_pairs'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:46:36.737164 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-3a2f4200-ebaf-4d51-93e8-8de93e67b14f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045149 Jul 20 09:46:36.738207 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 517/1016] 10.222.0.18 () {60 vars in 1158 bytes} [Wed Jul 20 09:46:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:46:36.809364 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-dfb903d7-34a5-4dea-947c-b181801edd48 req-cc44edeb-e533-4536-8cb8-aa180ac8ebf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95", "tag": "361144e0-fc56-4c8c-b382-29b23daf98dd"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:36.818845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-dfb903d7-34a5-4dea-947c-b181801edd48 req-cc44edeb-e533-4536-8cb8-aa180ac8ebf3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:36.819797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-dfb903d7-34a5-4dea-947c-b181801edd48 req-cc44edeb-e533-4536-8cb8-aa180ac8ebf3 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:36.832609 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-dfb903d7-34a5-4dea-947c-b181801edd48 req-cc44edeb-e533-4536-8cb8-aa180ac8ebf3 service nova] Creating event network-changed:361144e0-fc56-4c8c-b382-29b23daf98dd for instance 2a53f48f-0f3d-4cd4-95aa-7313bfc2cb95 on hv-cinder-82282 Jul 20 09:46:36.838647 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-dfb903d7-34a5-4dea-947c-b181801edd48 req-cc44edeb-e533-4536-8cb8-aa180ac8ebf3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033446 Jul 20 09:46:36.839253 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 500/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:38.260001 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-421046539", "imageRef": "99755edb-4401-48ba-8dda-bc4dba7d4f92", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6671a0fd-e3f4-4bae-a778-86d0bc616f5d"}], "security_groups": [{"name": "tempest-securitygroup--1588239077"}], "key_name": "tempest-keypair-817668503", "user_data": "}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:38.363511 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.network.neutron [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] validate_networks() for [('6671a0fd-e3f4-4bae-a778-86d0bc616f5d', None, None, None, None, None)] {{(pid=124373) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:46:38.742635 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:46:38.743129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image limits 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:46:38.743715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Flavor pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:46:38.744158 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Image pref 0:0:0 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:46:38.744692 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.virt.hardware [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:46:38.753704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:38.754275 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:38.755084 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:38.755549 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:38.772671 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:46:38.776587 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.quota [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Getting quotas for user ae56ce45fd2d4acab2c1959a45dfe00b and project a1fe308758354ddfb050def8345355ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124373) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:46:38.788268 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Going to run 1 instances... {{(pid=124373) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:46:38.790571 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99755edb-4401-48ba-8dda-bc4dba7d4f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124373) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:46:38.839589 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-2cc0b575-755d-498b-970e-2561a619e91c tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584384 Jul 20 09:46:38.840249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 518/1018] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:46:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:46:38.851487 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-9d41a334-94d7-41cd-a5af-1bda97149fc0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:38.852199 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-9d41a334-94d7-41cd-a5af-1bda97149fc0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:38.946075 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-9d41a334-94d7-41cd-a5af-1bda97149fc0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:38.953462 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-9d41a334-94d7-41cd-a5af-1bda97149fc0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1240 microversion: 2.1 time: 0.106887 Jul 20 09:46:38.954027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 501/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:38 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:39.786928 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:39.787986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:39.795432 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.796132 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.796628 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-88ba8f37-a62e-4879-ae10-7cc4ccd71c1d req-d36f2fb6-0ba0-4d4d-9075-39125a68d420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:39.797257 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.798056 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.819939 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-88ba8f37-a62e-4879-ae10-7cc4ccd71c1d req-d36f2fb6-0ba0-4d4d-9075-39125a68d420 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.820458 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-88ba8f37-a62e-4879-ae10-7cc4ccd71c1d req-d36f2fb6-0ba0-4d4d-9075-39125a68d420 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.829910 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:46:39.835690 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-88ba8f37-a62e-4879-ae10-7cc4ccd71c1d req-d36f2fb6-0ba0-4d4d-9075-39125a68d420 service nova] Creating event network-changed:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:46:39.841438 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-88ba8f37-a62e-4879-ae10-7cc4ccd71c1d req-d36f2fb6-0ba0-4d4d-9075-39125a68d420 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053240 Jul 20 09:46:39.842819 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 502/1020] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:39.879115 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:39.932973 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-72d26565-74da-40e4-9579-a0dbca66b877 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "DELETE /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 204 len: 0 microversion: 2.1 time: 0.149740 Jul 20 09:46:39.934455 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 519/1021] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:46:39 2022] DELETE /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:46:39.943991 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:39.947036 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:39.956217 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.957775 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.958867 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.959523 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.975416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:39.976125 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:39.983793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.984478 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:39.985506 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:39.987408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:40.061864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:40.071181 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6531aed4-ce5a-43ac-a1a7-46b60ec175da tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1310 microversion: 2.1 time: 0.102400 Jul 20 09:46:40.072114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 520/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:39 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:40.106779 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:40.115836 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-928d3b14-5bf7-4e64-a244-0430e28d8bb2 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.176705 Jul 20 09:46:40.116521 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 503/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:39 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:41.088371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:41.088986 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:41.095429 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:41.095877 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:41.096636 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:41.097070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:41.134087 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:41.134702 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:41.142266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:41.143113 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:41.143999 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:41.145377 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:41.161827 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:41.169895 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-d842e069-75c8-4629-a7c1-7306d041b9cc tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1298 microversion: 2.1 time: 0.085419 Jul 20 09:46:41.170622 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 521/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:41 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:41.384714 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:41.392210 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b213d23c-79ec-4b64-adf7-cc03f632380e tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1569 microversion: 2.1 time: 0.262024 Jul 20 09:46:41.392790 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 504/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:41 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:42.187175 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:42.187821 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:42.195055 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:42.195529 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:42.196297 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:42.196732 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:42.334555 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:42.343886 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-21859bfb-9dce-424e-b485-c3517e453208 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.160575 Jul 20 09:46:42.344681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 522/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:42 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:42.410280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:42.411731 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:42.420980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:42.422348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:42.423484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:42.424074 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:42.520509 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0821d7c651dc4571834b8f3c40b225a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1753001c624ae3941cfc51b3d9d6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:42.530884 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-4f799dac-b2a0-4635-a318-0de4a39aca15 tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 200 len: 1382 microversion: 2.1 time: 0.124663 Jul 20 09:46:42.532100 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 505/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:42 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 1382 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:42.590022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-486df620-bdd0-4399-b336-dcaed19f6fda req-d96da499-ee74-43e5-8865-2dff0cae9ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11204e32-acb1-4e5d-ab38-0c9f0ded5172", "name": "network-vif-deleted", "tag": "1b469bba-5a64-4111-b2f1-bc9db9a2f793"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:42.601258 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-486df620-bdd0-4399-b336-dcaed19f6fda req-d96da499-ee74-43e5-8865-2dff0cae9ac6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:42.603881 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-486df620-bdd0-4399-b336-dcaed19f6fda req-d96da499-ee74-43e5-8865-2dff0cae9ac6 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:42.615923 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-486df620-bdd0-4399-b336-dcaed19f6fda req-d96da499-ee74-43e5-8865-2dff0cae9ac6 service nova] Creating event network-vif-deleted:1b469bba-5a64-4111-b2f1-bc9db9a2f793 for instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 on hv-cinder-82282 Jul 20 09:46:42.620917 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-486df620-bdd0-4399-b336-dcaed19f6fda req-d96da499-ee74-43e5-8865-2dff0cae9ac6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129128 Jul 20 09:46:42.621693 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 523/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:43.366639 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:43.367414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:43.374020 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:43.374474 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:43.375222 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:43.375673 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:43.550007 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:43.550704 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] [instance: 11204e32-acb1-4e5d-ab38-0c9f0ded5172] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:43.556888 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:43.557333 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:43.558118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:43.558625 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:43.573837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] HTTP exception thrown: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Request method failure captured: Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 HTTP/1.1 Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi183lhKFKgFRdnrfV1EvX468rn6F9_CqnIte_iHxS4UY08t-HK6WCZ_tbofed9TADYJIc0BrnhH9rHxxMkzhBltIyKW3JhC9aJa4ajAc2ZW3d2f0j12PKZNOEXmbICLs56DYtBV87PX_oiHfLDn3FdPEU7ufWE2yN_OBCoifPt9M9boE Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: ee1753001c624ae3941cfc51b3d9d6ef Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-TestShelveInstance-1745111130 Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:46:43.576102 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee1753001c624ae3941cfc51b3d9d6ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee1753001c624ae3941cfc51b3d9d6ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee1753001c624ae3941cfc51b3d9d6ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee1753001c624ae3941cfc51b3d9d6ef"}]}] Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-TestShelveInstance-1745111130 Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: ee1753001c624ae3941cfc51b3d9d6ef Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-TestShelveInstance-1745111130 Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-TestShelveInstance-1745111130-project Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 0821d7c651dc4571834b8f3c40b225a9 Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-TestShelveInstance-1745111130-project Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. Jul 20 09:46:43.577855 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '11204e32-acb1-4e5d-ab38-0c9f0ded5172'} Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:46:43.578846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. Jul 20 09:46:43.580414 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:46:43.581789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Returning 404 to user: Instance 11204e32-acb1-4e5d-ab38-0c9f0ded5172 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:46:43.581789 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-1b8e3cba-4c1d-462b-8e41-0057c5223caa tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172" status: 404 len: 111 microversion: 2.1 time: 0.032969 Jul 20 09:46:43.582164 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 524/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:43 2022] GET /compute/v2.1/servers/11204e32-acb1-4e5d-ab38-0c9f0ded5172 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:46:43.586629 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:43.594786 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-37082791-b994-4cbb-a71c-dc87defe919f tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.232597 Jul 20 09:46:43.595742 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 506/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:43 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:43.742380 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7ae99f25-e1ac-4198-a905-e843c4614cff tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] Calling method '.version_select at 0x7f81f45e4940>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:43.763564 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7ae99f25-e1ac-4198-a905-e843c4614cff tempest-TestShelveInstance-1745111130 tempest-TestShelveInstance-1745111130-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1330071063" status: 202 len: 0 microversion: 2.1 time: 0.025836 Jul 20 09:46:43.764246 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 525/1031] 10.222.0.18 () {58 vars in 1253 bytes} [Wed Jul 20 09:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1330071063 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:46:44.612015 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:44.612622 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:44.619340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:44.620267 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:44.620551 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:44.620986 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:44.640416 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-06614d58-805f-46f8-b1ff-1bf774935d22 req-83003249-b587-447e-a424-1058f752d076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc5aebd-3667-40db-89cc-d0e7578721cf", "tag": "d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:44.650954 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-06614d58-805f-46f8-b1ff-1bf774935d22 req-83003249-b587-447e-a424-1058f752d076 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:44.651592 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-06614d58-805f-46f8-b1ff-1bf774935d22 req-83003249-b587-447e-a424-1058f752d076 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:44.662915 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-06614d58-805f-46f8-b1ff-1bf774935d22 req-83003249-b587-447e-a424-1058f752d076 service nova] Creating event network-changed:d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c for instance adc5aebd-3667-40db-89cc-d0e7578721cf on hv-cinder-82282 Jul 20 09:46:44.668393 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-06614d58-805f-46f8-b1ff-1bf774935d22 req-83003249-b587-447e-a424-1058f752d076 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031802 Jul 20 09:46:44.669092 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 526/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:46:44.844420 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:44.875014 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-076cf395-ddb2-42ab-84a8-a52db3216514 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.266781 Jul 20 09:46:44.875824 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 507/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:44 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:45.894343 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:45.896165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:45.898213 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:45.903885 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:45.904519 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:45.905579 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:45.906179 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:46.173243 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:46.181112 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8012b8d8-343e-432c-8351-e3a41d4e30e0 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.292452 Jul 20 09:46:46.181675 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 527/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:45 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:47.198135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:47.198741 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:47.201197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:47.206476 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:47.206919 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:47.208306 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:47.208740 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:47.346351 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:47.354103 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-8befd033-a1a5-4def-9400-2edd6db2d187 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.159731 Jul 20 09:46:47.354681 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 508/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:47 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:48.371575 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:48.372185 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:48.378681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:48.379127 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:48.379918 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:48.380353 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:48.609034 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:48.616490 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6a38d5cd-cd9c-4ed1-9ee0-c2b1b9450396 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.248951 Jul 20 09:46:48.617057 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 528/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:48 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:49.117849 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-eaf31a3d-fd35-477b-8294-46ef5f08d46e req-6fa56d7a-0c6b-4599-a92d-6c700686271c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc5aebd-3667-40db-89cc-d0e7578721cf", "name": "network-vif-plugged", "status": "completed", "tag": "d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:49.121764 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:49.136485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-eaf31a3d-fd35-477b-8294-46ef5f08d46e req-6fa56d7a-0c6b-4599-a92d-6c700686271c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:49.137191 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-eaf31a3d-fd35-477b-8294-46ef5f08d46e req-6fa56d7a-0c6b-4599-a92d-6c700686271c service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:49.150361 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-eaf31a3d-fd35-477b-8294-46ef5f08d46e req-6fa56d7a-0c6b-4599-a92d-6c700686271c service nova] Creating event network-vif-plugged:d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c for instance adc5aebd-3667-40db-89cc-d0e7578721cf on hv-cinder-82282 Jul 20 09:46:49.163990 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-eaf31a3d-fd35-477b-8294-46ef5f08d46e req-6fa56d7a-0c6b-4599-a92d-6c700686271c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050195 Jul 20 09:46:49.164600 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 509/1037] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:49.633793 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:49.635215 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:49.638471 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:49.639114 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell0:SELECT=10 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:46:49.644169 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:49.644670 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:49.645450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:49.645989 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:49.890482 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:49.900992 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-c691ce1b-ad0c-4c5e-9669-c4454b476714 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.271478 Jul 20 09:46:49.901832 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 529/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:49 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:50.919552 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:50.920340 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:50.928221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:50.928670 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:50.929528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:50.930032 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:51.074318 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:51.081782 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e98d551e-0003-4fe9-bcf8-1b4b4be58ca9 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1366 microversion: 2.1 time: 0.166722 Jul 20 09:46:51.082415 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 510/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:50 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:46:52.099971 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:52.100575 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:52.106984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:52.107465 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:52.108236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:52.108662 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:52.241981 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:46:52.249448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0c91007d-e5f6-4a87-a9ae-36c9d6b41b67 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1557 microversion: 2.1 time: 0.154250 Jul 20 09:46:52.250009 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 530/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:46:52 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:46:52.265141 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:46:52.265631 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:46:52.272573 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:52.273013 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:52.273762 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:52.274186 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:52.355497 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-020be020-f742-4224-b4e5-cd4e29d55b6d tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094088 Jul 20 09:46:52.356090 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 511/1041] 10.222.0.18 () {58 vars in 1274 bytes} [Wed Jul 20 09:46:52 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:46:53.268481 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-cc483f0f-eeeb-4099-b9ef-01e304a46cbd req-0e9e0768-7c74-4d1c-8308-e368ccb78d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc5aebd-3667-40db-89cc-d0e7578721cf", "tag": "d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:46:53.277654 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-cc483f0f-eeeb-4099-b9ef-01e304a46cbd req-0e9e0768-7c74-4d1c-8308-e368ccb78d8a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:46:53.278172 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-cc483f0f-eeeb-4099-b9ef-01e304a46cbd req-0e9e0768-7c74-4d1c-8308-e368ccb78d8a service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:46:53.290701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-cc483f0f-eeeb-4099-b9ef-01e304a46cbd req-0e9e0768-7c74-4d1c-8308-e368ccb78d8a service nova] Creating event network-changed:d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c for instance adc5aebd-3667-40db-89cc-d0e7578721cf on hv-cinder-82282 Jul 20 09:46:53.296228 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-cc483f0f-eeeb-4099-b9ef-01e304a46cbd req-0e9e0768-7c74-4d1c-8308-e368ccb78d8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031425 Jul 20 09:46:53.297099 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 531/1042] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:47:31.243282 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=7 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:31.243994 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:31.248067 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:31.248556 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:31.255613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:31.256057 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:31.256814 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:31.257244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:31.283214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-fae24012-3698-4553-9f69-c17f7aae7884 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/ips" status: 200 len: 151 microversion: 2.1 time: 0.041624 Jul 20 09:47:31.283894 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 512/1043] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:47:31 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:47:32.591070 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=9 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:32.591853 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:47:32.596402 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a165f2c1-9c6f-4d79-988e-ac07c401e86d"}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:47:32.597552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:32.605442 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:32.605882 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:32.606638 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:32.607071 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:32.836878 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-4674545d-a083-4752-a26d-3d9975321b47 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "POST /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247234 Jul 20 09:47:32.837494 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 532/1044] 10.222.0.18 () {60 vars in 1322 bytes} [Wed Jul 20 09:47:32 2022] POST /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:47:39.362915 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:39.363459 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:39.370468 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:39.370935 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:39.371712 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:39.372137 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:39.451620 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.objects.instance [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lazy-loading 'services' on Instance uuid adc5aebd-3667-40db-89cc-d0e7578721cf {{(pid=124374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:47:39.521480 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-f914ba21-41f7-4fc4-bf85-ef90ac61e417 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments/a165f2c1-9c6f-4d79-988e-ac07c401e86d" status: 202 len: 0 microversion: 2.1 time: 0.162318 Jul 20 09:47:39.522069 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 513/1045] 10.222.0.18 () {58 vars in 1415 bytes} [Wed Jul 20 09:47:39 2022] DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments/a165f2c1-9c6f-4d79-988e-ac07c401e86d => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:47:39.531451 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:39.532454 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:39.538623 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:39.539011 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:39.539800 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:39.540236 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:39.571744 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a43a654c-1ce0-4aec-a422-5e3288219b70 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Jul 20 09:47:39.572330 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 533/1046] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:47:39 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:47:40.584485 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:40.585484 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:40.591774 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.592209 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.592969 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.593390 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.621136 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-c6b3cfd2-4014-42b1-977d-394c28230945 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041420 Jul 20 09:47:40.621675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 514/1047] 10.222.0.18 () {58 vars in 1301 bytes} [Wed Jul 20 09:47:40 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:47:40.678448 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:40.678935 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:40.685983 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.686428 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.687184 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.687646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.712545 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Going to try to terminate instance {{(pid=124373) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:47:40.784939 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-82511603-830c-4604-acb5-3fdec047f421 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 204 len: 0 microversion: 2.1 time: 0.110051 Jul 20 09:47:40.785552 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 534/1048] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:47:40 2022] DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:47:40.795266 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:40.795898 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:40.801758 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.802197 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.802953 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:40.803413 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:40.938158 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:47:40.945644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-297aaa36-0a73-4356-95e1-644386fdc961 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1682 microversion: 2.1 time: 0.155472 Jul 20 09:47:40.946202 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 515/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:40 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:47:41.964408 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:41.965254 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:41.971766 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:41.972204 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:41.972948 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:41.973371 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:42.105809 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:47:42.113181 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-8ec0725e-7604-4408-9f48-95c73f434a2b tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1682 microversion: 2.1 time: 0.153704 Jul 20 09:47:42.113736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 535/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:41 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:47:43.130695 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:43.131367 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:43.138214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:43.138659 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:43.139469 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:43.139908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:43.401221 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae56ce45fd2d4acab2c1959a45dfe00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1fe308758354ddfb050def8345355ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:47:43.409194 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-5081c462-c8bb-4aea-8eed-6b9f3600f577 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 200 len: 1614 microversion: 2.1 time: 0.282417 Jul 20 09:47:43.413264 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 516/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:43 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 1614 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:47:43.477142 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [req-bcdc44ea-4c30-4621-b4cd-2e5f301e3c32 req-cc456eaa-6f9b-4f98-b8d7-71338192c3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc5aebd-3667-40db-89cc-d0e7578721cf", "name": "network-vif-deleted", "tag": "d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c"}]} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:47:43.487967 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bcdc44ea-4c30-4621-b4cd-2e5f301e3c32 req-cc456eaa-6f9b-4f98-b8d7-71338192c3d9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:43.488495 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [req-bcdc44ea-4c30-4621-b4cd-2e5f301e3c32 req-cc456eaa-6f9b-4f98-b8d7-71338192c3d9 service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:43.501550 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.compute.server_external_events [req-bcdc44ea-4c30-4621-b4cd-2e5f301e3c32 req-cc456eaa-6f9b-4f98-b8d7-71338192c3d9 service nova] Creating event network-vif-deleted:d47a4e50-b0d8-48d1-965b-e5ec0a4ca77c for instance adc5aebd-3667-40db-89cc-d0e7578721cf on hv-cinder-82282 Jul 20 09:47:43.506608 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [req-bcdc44ea-4c30-4621-b4cd-2e5f301e3c32 req-cc456eaa-6f9b-4f98-b8d7-71338192c3d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Jul 20 09:47:43.508150 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 536/1052] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:47:44.426160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:44.426767 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:44.433971 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:44.434356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:44.435115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:44.435672 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:44.449965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf HTTP/1.1 Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:44.451648 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:44.453296 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'adc5aebd-3667-40db-89cc-d0e7578721cf'} Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:44.454216 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:44.455613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:44.457134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:44.457134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b027eb53-deb0-4b62-8a45-833f08b49c55 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 404 len: 111 microversion: 2.1 time: 0.030758 Jul 20 09:47:44.457134 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 517/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:44 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:44.462715 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-0469fce3-ddcb-4bda-9008-9190b5dfe6ec tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '.version_select at 0x7f81f44bb3a0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:44.481259 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-0469fce3-ddcb-4bda-9008-9190b5dfe6ec tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817668503" status: 202 len: 0 microversion: 2.1 time: 0.022666 Jul 20 09:47:44.484559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 537/1054] 10.222.0.18 () {58 vars in 1217 bytes} [Wed Jul 20 09:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817668503 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:47:46.226436 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:46.226923 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:46.233897 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:46.234336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:46.235084 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:46.235540 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:46.249354 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf HTTP/1.1 Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:46.250868 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.252510 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'adc5aebd-3667-40db-89cc-d0e7578721cf'} Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:46.253424 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.254933 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.256711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:46.256711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-78759b51-f8b7-447b-a87b-36a86c9e1a82 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 404 len: 111 microversion: 2.1 time: 0.029685 Jul 20 09:47:46.256711 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 518/1055] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:47:46 2022] DELETE /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:46.261436 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:46.262170 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: adc5aebd-3667-40db-89cc-d0e7578721cf] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:46.268299 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:46.268750 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:46.269507 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:46.269942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:46.283072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf HTTP/1.1 Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:46.284721 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.286312 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'adc5aebd-3667-40db-89cc-d0e7578721cf'} Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:46.287202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. Jul 20 09:47:46.288729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:46.290080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance adc5aebd-3667-40db-89cc-d0e7578721cf could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:46.290080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-995dbb46-18c3-4cde-a0d1-f4ee0e013bcd tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf" status: 404 len: 111 microversion: 2.1 time: 0.029276 Jul 20 09:47:46.290080 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 538/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:46 2022] GET /compute/v2.1/servers/adc5aebd-3667-40db-89cc-d0e7578721cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:47.420644 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:47.421145 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:47.427501 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.427942 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.428692 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.429116 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.442751 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c HTTP/1.1 Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:47.444569 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.446213 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'ce3dce63-78c9-445f-8b86-bc9756df776c'} Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:47.447153 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.449678 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.451160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:47.451160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d5ce15d6-f1ba-4308-be58-f802c17bdca4 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 404 len: 111 microversion: 2.1 time: 0.029145 Jul 20 09:47:47.451160 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 519/1057] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:47:47 2022] DELETE /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:47.454934 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:47.455528 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ce3dce63-78c9-445f-8b86-bc9756df776c] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:47.461919 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.462365 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.463113 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.463572 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.477270 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c HTTP/1.1 Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:47.478770 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.480846 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'ce3dce63-78c9-445f-8b86-bc9756df776c'} Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:47.481698 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. Jul 20 09:47:47.482945 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.484152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ce3dce63-78c9-445f-8b86-bc9756df776c could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:47.484152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-03aec7a7-8397-47ee-9efe-0b3f6d771bf5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c" status: 404 len: 111 microversion: 2.1 time: 0.029178 Jul 20 09:47:47.484152 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 539/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:47 2022] GET /compute/v2.1/servers/ce3dce63-78c9-445f-8b86-bc9756df776c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:47.488726 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:47.489214 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:47.495528 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.495958 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.496699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.497118 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.510279 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef HTTP/1.1 Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:47.512352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.513973 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': '222645e9-a074-436a-b823-1e91a831e7ef'} Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:47.514855 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.516451 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.517892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:47.517892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-7bcee034-6959-41e6-b63e-5a80e7eae4c5 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 404 len: 111 microversion: 2.1 time: 0.028852 Jul 20 09:47:47.517892 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 520/1059] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:47:47 2022] DELETE /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:47.521957 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:47.522563 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: 222645e9-a074-436a-b823-1e91a831e7ef] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:47.529405 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.529850 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.530597 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:47.531038 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:47.544306 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef HTTP/1.1 Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:47.546118 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.547830 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '222645e9-a074-436a-b823-1e91a831e7ef'} Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:47.548716 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. Jul 20 09:47:47.549942 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:47.551051 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance 222645e9-a074-436a-b823-1e91a831e7ef could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:47.551051 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-7d5362fc-4404-40e6-a60e-e15ed3020019 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef" status: 404 len: 111 microversion: 2.1 time: 0.029398 Jul 20 09:47:47.551051 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 540/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:47 2022] GET /compute/v2.1/servers/222645e9-a074-436a-b823-1e91a831e7ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:48.681718 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:48.682219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:48.688872 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:48.689311 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:48.690050 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:48.690471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:48.704303 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 HTTP/1.1 Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:48.705797 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: > Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.707414 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'ac77738b-4bd2-4a70-b5f1-50f154fbf3f1'} Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:48.708471 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.709980 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.711661 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:48.711661 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-73f7edbd-8c60-417d-8f7b-8a8ee042c8c8 tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 404 len: 111 microversion: 2.1 time: 0.029222 Jul 20 09:47:48.711661 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 521/1061] 10.222.0.18 () {58 vars in 1238 bytes} [Wed Jul 20 09:47:48 2022] DELETE /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:48.717473 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:48.718082 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] [instance: ac77738b-4bd2-4a70-b5f1-50f154fbf3f1] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:47:48.724469 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:48.724917 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:48.725701 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:47:48.726129 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:47:48.740022 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] HTTP exception thrown: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Request method failure captured: Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 HTTP/1.1 Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi1844Q17EXO0B9bmQ7D_llmdD2dI_x_rOWd2-XBlFEG8TyH78bqIQSzyS0uZYWq9Z-Cy4zbBUMvcw7D5W4CFDYWTmSeQ2GZsaV9Fvou8DCYDe-P3ZN7HdHu-RPxBjSuIVFLJBRbbRE9v8fZsA7_Dx5UBkW0cGei5n_VmU_DEEwH1WDAk Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:48.741520 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a1fe308758354ddfb050def8345355ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a1fe308758354ddfb050def8345355ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a1fe308758354ddfb050def8345355ff"}]}] Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: a1fe308758354ddfb050def8345355ff Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-365090779 Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: ae56ce45fd2d4acab2c1959a45dfe00b Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-AttachVolumeNegativeTest-365090779-project Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: > Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.743116 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'ac77738b-4bd2-4a70-b5f1-50f154fbf3f1'} Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:48.744073 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. Jul 20 09:47:48.745630 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:48.747815 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] Returning 404 to user: Instance ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:48.747815 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-43910ad9-792e-4799-a9a3-1d022fdd9c1e tempest-AttachVolumeNegativeTest-365090779 tempest-AttachVolumeNegativeTest-365090779-project] 10.222.0.18 "GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1" status: 404 len: 111 microversion: 2.1 time: 0.029871 Jul 20 09:47:48.747815 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 541/1062] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:47:48 2022] GET /compute/v2.1/servers/ac77738b-4bd2-4a70-b5f1-50f154fbf3f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:47:53.003780 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-029d5d83-f71a-4534-9638-c1ab00dfea4f tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Action: 'create', calling method: .version_select at 0x7f81f4321430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2050966169", "metadata": {"Type": "work"}}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-029d5d83-f71a-4534-9638-c1ab00dfea4f tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 122 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:53.018699 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2050966169", "metadata": {"Type": "work"}}} Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: Jul 20 09:47:53.020512 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2050966169', 'metadata': {'Type': 'work'}}}} Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.021675 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:47:53.023208 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:47:53.024843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:47:53.024843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.024843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-029d5d83-f71a-4534-9638-c1ab00dfea4f tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.024843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-029d5d83-f71a-4534-9638-c1ab00dfea4f tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.130042 Jul 20 09:47:53.024843 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 522/1063] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jul 20 09:47:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:47:53.030798 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-99af3860-0a50-4f45-955d-23ba9c13c92c tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Action: 'create', calling method: .version_select at 0x7f81f42b2a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313162889", "metadata": {"Type": "work"}}} {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-99af3860-0a50-4f45-955d-23ba9c13c92c tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 120 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:53.033985 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1313162889", "metadata": {"Type": "work"}}} Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:47:53.035646 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1313162889', 'metadata': {'Type': 'work'}}}} Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi '0' Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.036612 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:47:53.038280 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:47:53.039768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:47:53.039768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.039768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-99af3860-0a50-4f45-955d-23ba9c13c92c tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.039768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-99af3860-0a50-4f45-955d-23ba9c13c92c tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008894 Jul 20 09:47:53.039768 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 542/1064] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jul 20 09:47:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:47:53.044443 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b68434f4-fda0-4d0f-8340-2a960e263823 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Action: 'create', calling method: .version_select at 0x7f81f44e85e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1160802653", "metadata": {"Type": "work"}}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b68434f4-fda0-4d0f-8340-2a960e263823 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 119 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:53.046983 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1160802653", "metadata": {"Type": "work"}}} Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: Jul 20 09:47:53.048694 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1160802653', 'metadata': {'Type': 'work'}}}} Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi '' Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.049599 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:47:53.050978 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:47:53.052219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:47:53.052219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.052219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-b68434f4-fda0-4d0f-8340-2a960e263823 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.052219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-b68434f4-fda0-4d0f-8340-2a960e263823 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007746 Jul 20 09:47:53.052219 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 523/1065] 10.222.0.18 () {60 vars in 1155 bytes} [Wed Jul 20 09:47:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 09:47:53.058335 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62fd3343-f865-4fc1-b547-7763399b6fd4 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Calling method '.version_select at 0x7f81f4489700>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:53.089518 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-62fd3343-f865-4fc1-b547-7763399b6fd4 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] HTTP exception thrown: Volume tempest-invalid-939911500 could not be found. Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62fd3343-f865-4fc1-b547-7763399b6fd4 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-939911500 HTTP/1.1 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:53.091489 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Volume tempest-invalid-939911500 could not be found. Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': 'tempest-invalid-939911500'} Jul 20 09:47:53.093198 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-939911500 could not be found. (HTTP 404) (Request-ID: req-cc564f5a-6eab-4d89-b876-500fc8f5370e) Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.094160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:47:53.095461 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-939911500 could not be found. Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:53.096682 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-939911500 could not be found. Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-939911500 could not be found. Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-62fd3343-f865-4fc1-b547-7763399b6fd4 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 404 to user: Volume tempest-invalid-939911500 could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-62fd3343-f865-4fc1-b547-7763399b6fd4 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-939911500" status: 404 len: 98 microversion: 2.1 time: 0.039237 Jul 20 09:47:53.098249 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 543/1066] 10.222.0.18 () {58 vars in 1214 bytes} [Wed Jul 20 09:47:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-939911500 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:47:53.105077 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-da98940c-fac1-4793-9f21-2daacb2e9bc9 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004024 Jul 20 09:47:53.105576 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 524/1067] 10.222.0.18 () {58 vars in 1139 bytes} [Wed Jul 20 09:47:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 09:47:53.114381 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9d72a0f9-77f6-468c-a2ed-3c8807709ad9 tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003749 Jul 20 09:47:53.114868 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 544/1068] 10.222.0.18 () {58 vars in 1136 bytes} [Wed Jul 20 09:47:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 09:47:53.123352 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-988fcb4f-b2f6-4e93-9fa7-b9c99201fd5e tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Calling method '.version_select at 0x7f81f4574940>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:53.151155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.wsgi [None req-988fcb4f-b2f6-4e93-9fa7-b9c99201fd5e tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] HTTP exception thrown: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-988fcb4f-b2f6-4e93-9fa7-b9c99201fd5e tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: request: DELETE /compute/v2.1/os-volumes/d6dd6f38-c866-49f0-9760-cf615b43ce9c HTTP/1.1 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept: application/json Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Accept-Encoding: identity Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Connection: close Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Length: 0 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Content-Type: application/json Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Host: 10.222.0.18 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Openstack-System-Scope: None Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Id: None Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Domain-Name: None Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Identity-Status: Confirmed Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Is-Admin-Project: True Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Id: default Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Domain-Name: Default Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Role: reader,member Jul 20 09:47:53.153616 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Roles: reader,member Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Id: default Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Domain-Name: Default Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: method: Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: exception: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: action_args: {'id': 'd6dd6f38-c866-49f0-9760-cf615b43ce9c'} Jul 20 09:47:53.155071 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. (HTTP 404) (Request-ID: req-8255a18a-d436-4cb4-9ffa-eccfc7ebc8c6) Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.156027 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:47:53.157518 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:47:53.158965 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-988fcb4f-b2f6-4e93-9fa7-b9c99201fd5e tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 404 to user: Volume d6dd6f38-c866-49f0-9760-cf615b43ce9c could not be found. {{(pid=124374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-988fcb4f-b2f6-4e93-9fa7-b9c99201fd5e tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/d6dd6f38-c866-49f0-9760-cf615b43ce9c" status: 404 len: 109 microversion: 2.1 time: 0.035688 Jul 20 09:47:53.160522 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 525/1069] 10.222.0.18 () {58 vars in 1247 bytes} [Wed Jul 20 09:47:53 2022] DELETE /compute/v2.1/os-volumes/d6dd6f38-c866-49f0-9760-cf615b43ce9c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:47:53.164669 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-81013458-2fd3-4619-b4a7-846a05edb65d tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Calling method '.version_select at 0x7f81f4786ca0>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:47:53.191854 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.wsgi [None req-81013458-2fd3-4619-b4a7-846a05edb65d tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] HTTP exception thrown: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-81013458-2fd3-4619-b4a7-846a05edb65d tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Request method failure captured: Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: request: GET /compute/v2.1/os-volumes/6c98b470-5ff9-4e57-8767-ec1b0ea005cc HTTP/1.1 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept: application/json Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Accept-Encoding: identity Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Connection: close Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Length: 0 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Content-Type: application/json Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Host: 10.222.0.18 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Openstack-System-Scope: None Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: User-Agent: python-urllib3/1.26.9 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Auth-Token: gAAAAABi189IUGW8c-1LmIo9SB1v9xjt4iJlgSoviEE45DF9Lw8H9GRt2yWAvRhTvmBlWCoReMU4W2BQ1covuoQOLtZDpQaUx6ah6ZP8mdB04G9glWnPuULNqZFP3cPkiY8Vs9jmn5FXM0SIEepcr7lsnPW0OzSJ6QhCr-FFa8OC5zWISwsAnzE Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Id: None Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Domain-Name: None Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Identity-Status: Confirmed Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Is-Admin-Project: True Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Id: default Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Domain-Name: Default Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Project-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Role: reader,member Jul 20 09:47:53.193775 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Roles: reader,member Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/383efe1b3a2b4d379d0d5671c3b6ace2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/383efe1b3a2b4d379d0d5671c3b6ace2"}]}] Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Id: 383efe1b3a2b4d379d0d5671c3b6ace2 Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-Tenant-Name: tempest-VolumesNegativeTest-1368634773 Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Id: default Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Domain-Name: Default Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Id: 5c8b872e82c54f7591c8dd3705da1aff Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: X-User-Name: tempest-VolumesNegativeTest-1368634773-project Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: method: Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: exception: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: action_args: {'id': '6c98b470-5ff9-4e57-8767-ec1b0ea005cc'} Jul 20 09:47:53.195426 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. (HTTP 404) (Request-ID: req-336c22db-6d30-4be3-aae8-9ee088cf9f78) Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.196439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:47:53.198423 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:47:53.199984 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: ERROR nova.api.openstack.wsgi Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-81013458-2fd3-4619-b4a7-846a05edb65d tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] Returning 404 to user: Volume 6c98b470-5ff9-4e57-8767-ec1b0ea005cc could not be found. {{(pid=124373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-81013458-2fd3-4619-b4a7-846a05edb65d tempest-VolumesNegativeTest-1368634773 tempest-VolumesNegativeTest-1368634773-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c98b470-5ff9-4e57-8767-ec1b0ea005cc" status: 404 len: 109 microversion: 2.1 time: 0.034400 Jul 20 09:47:53.201450 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 545/1070] 10.222.0.18 () {58 vars in 1244 bytes} [Wed Jul 20 09:47:53 2022] GET /compute/v2.1/os-volumes/6c98b470-5ff9-4e57-8767-ec1b0ea005cc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:48:11.374140 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_api:SELECT=20 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:11.374922 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:11.379580 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-859274329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-926131090", "security_groups": [{"name": "tempest-secgroup-smoke-1069216155"}], "block_device_mapping_v2": [{"uuid": "6b94e3f2-d8cb-4377-b529-8111bffd43d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49ad933c-e19c-4fd1-95f5-c5db07071624"}]}} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:48:11.495336 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.network.neutron [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] validate_networks() for [('49ad933c-e19c-4fd1-95f5-c5db07071624', None, None, None, None, None)] {{(pid=124374) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:48:11.969356 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:48:11.969772 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image limits 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:48:11.970244 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Flavor pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:48:11.970646 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Image pref 0:0:0 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:48:11.971095 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.virt.hardware [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:48:11.980395 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:11.980903 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:11.981945 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:11.982348 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:11.999115 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:48:12.007913 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.quota [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Getting quotas for user ac343929fc8542439bc627a1f445b1dd and project 42a88572ee8443d4a51617c04ca2f416. Resources: {'instances', 'ram', 'cores'} {{(pid=124374) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:48:12.063554 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Going to run 1 instances... {{(pid=124374) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:48:12.065890 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b94e3f2-d8cb-4377-b529-8111bffd43d8',volume_size=None,volume_type=None)] {{(pid=124374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:48:12.202488 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-bceca8bb-6682-4eea-8c84-0f20ab32cd0e tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829293 Jul 20 09:48:12.203091 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 526/1071] 10.222.0.18 () {60 vars in 1146 bytes} [Wed Jul 20 09:48:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:48:12.210366 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:12.212729 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG dbcounter [-] [124373] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:12.218386 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-6b8b4b25-bec5-413a-aafb-8ebe1841cad7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:12.219083 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-6b8b4b25-bec5-413a-aafb-8ebe1841cad7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:12.311017 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-6b8b4b25-bec5-413a-aafb-8ebe1841cad7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:12.323420 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-6b8b4b25-bec5-413a-aafb-8ebe1841cad7 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1093 microversion: 2.1 time: 0.114413 Jul 20 09:48:12.323999 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 546/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:12 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1093 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:13.351455 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:13.354280 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:13.364292 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:13.364976 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:13.366613 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:13.367142 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:13.451093 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:13.460625 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-d7c46dc0-7f42-46bb-b3ff-07ef1636df2a tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1209 microversion: 2.1 time: 0.122678 Jul 20 09:48:13.470845 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 527/1073] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:13 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:14.478266 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:14.479517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:14.486217 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:14.486873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:14.487736 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:14.488165 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:14.656160 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:14.665681 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-9ccae9bd-e9e0-46b0-b1a6-09a4819f78ac tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.191420 Jul 20 09:48:14.666272 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 547/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:14 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:14.811908 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-8e18ce6c-728d-40ef-91a1-2c7ee61a6b2a req-e508f62e-e18b-4e74-b350-9bd60a99bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e5fd17-c828-4cf0-a649-403fd2487d15", "tag": "b8b9cea8-dc15-4401-bb83-187f324dc257"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:48:14.831509 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8e18ce6c-728d-40ef-91a1-2c7ee61a6b2a req-e508f62e-e18b-4e74-b350-9bd60a99bf7f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:14.841048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-8e18ce6c-728d-40ef-91a1-2c7ee61a6b2a req-e508f62e-e18b-4e74-b350-9bd60a99bf7f service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:14.857784 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-8e18ce6c-728d-40ef-91a1-2c7ee61a6b2a req-e508f62e-e18b-4e74-b350-9bd60a99bf7f service nova] Creating event network-changed:b8b9cea8-dc15-4401-bb83-187f324dc257 for instance 91e5fd17-c828-4cf0-a649-403fd2487d15 on hv-cinder-82282 Jul 20 09:48:14.862907 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-8e18ce6c-728d-40ef-91a1-2c7ee61a6b2a req-e508f62e-e18b-4e74-b350-9bd60a99bf7f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055341 Jul 20 09:48:14.864227 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 528/1075] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:48:15.684281 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:15.684889 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:15.691382 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:15.691837 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:15.692605 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:15.693041 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:15.834864 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:15.842970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-87dc39d9-fb8b-42f9-9c74-da5cdec77865 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.162658 Jul 20 09:48:15.843588 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 548/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:15 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:16.859598 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:16.860293 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:16.866813 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:16.867262 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:16.868048 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:16.868478 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:17.003750 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:17.011155 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e8afe460-bf2f-4f36-b4d3-bfa0145acc15 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.156042 Jul 20 09:48:17.012575 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 529/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:16 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:48:18.028892 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:18.029514 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:18.035999 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:18.036445 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:18.037202 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:18.037634 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:18.173622 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:18.181072 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-ae011246-eb8a-4243-9c09-59378bc053db tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.156022 Jul 20 09:48:18.181856 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 549/1078] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:18 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:19.198263 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:19.198863 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.compute.api [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124374) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:19.205962 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:19.206401 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:19.207142 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:19.207588 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:19.335135 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.policy [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124374) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:19.344106 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [None req-e98c7ee4-ccde-49b8-bae0-c38d7d9c21e2 tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.149772 Jul 20 09:48:19.344686 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 530/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:19 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:20.360322 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.api.openstack.wsgi [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Calling method '>' {{(pid=124373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:48:20.360970 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.compute.api [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] [instance: 91e5fd17-c828-4cf0-a649-403fd2487d15] Fetching instance by UUID {{(pid=124373) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:48:20.367029 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:20.367517 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:20.368271 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:20.368707 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG oslo_concurrency.lockutils [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:20.504439 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: DEBUG nova.policy [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac343929fc8542439bc627a1f445b1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a88572ee8443d4a51617c04ca2f416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124373) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:48:20.511903 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO nova.api.openstack.requestlog [None req-a3f79e41-f7ed-4bb1-9e69-70d193b4205d tempest-TestVolumeBootPattern-1928445346 tempest-TestVolumeBootPattern-1928445346-project] 10.222.0.18 "GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15" status: 200 len: 1265 microversion: 2.1 time: 0.155475 Jul 20 09:48:20.512496 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: [pid: 124373|app: 0|req: 550/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Wed Jul 20 09:48:20 2022] GET /compute/v2.1/servers/91e5fd17-c828-4cf0-a649-403fd2487d15 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:48:25.467417 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=2 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:25.468488 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG dbcounter [-] [124374] Writing DB stats nova_cell0:SELECT=6 {{(pid=124374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:48:25.588065 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG nova.api.openstack.wsgi [req-62ad0132-c00e-40f8-adab-a3131ec6e2e4 req-0fe77e6c-eece-41a0-86f5-4c655d06455b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e5fd17-c828-4cf0-a649-403fd2487d15", "name": "network-vif-plugged", "status": "completed", "tag": "b8b9cea8-dc15-4401-bb83-187f324dc257"}]} {{(pid=124374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:48:25.596568 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-62ad0132-c00e-40f8-adab-a3131ec6e2e4 req-0fe77e6c-eece-41a0-86f5-4c655d06455b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:48:25.597006 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: DEBUG oslo_concurrency.lockutils [req-62ad0132-c00e-40f8-adab-a3131ec6e2e4 req-0fe77e6c-eece-41a0-86f5-4c655d06455b service nova] Lock "8680c429-cc49-4148-b6dc-1e5278bfc5a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:48:25.608275 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.compute.server_external_events [req-62ad0132-c00e-40f8-adab-a3131ec6e2e4 req-0fe77e6c-eece-41a0-86f5-4c655d06455b service nova] Creating event network-vif-plugged:b8b9cea8-dc15-4401-bb83-187f324dc257 for instance 91e5fd17-c828-4cf0-a649-403fd2487d15 on hv-cinder-82282 Jul 20 09:48:25.613180 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO nova.api.openstack.requestlog [req-62ad0132-c00e-40f8-adab-a3131ec6e2e4 req-0fe77e6c-eece-41a0-86f5-4c655d06455b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150511 Jul 20 09:48:25.613757 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: [pid: 124374|app: 0|req: 531/1081] 10.222.0.18 () {64 vars in 1317 bytes} [Wed Jul 20 09:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:49:08.455888 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 20 09:49:08.456523 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Wed Jul 20 09:49:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:49:23.090686 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:49:23.091916 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Wed Jul 20 09:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:50:53.865688 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:50:53.866559 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Wed Jul 20 09:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:51:00.531548 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:51:00.532147 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Wed Jul 20 09:51:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:51:27.486788 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:51:27.488164 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Wed Jul 20 09:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:52:28.464341 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:52:28.465075 dv-cinder-822822-3-iscsi devstack@n-api.service[124374]: Wed Jul 20 09:52:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:52:43.103589 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:52:43.104355 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Wed Jul 20 09:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:53:09.333138 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:53:09.333873 dv-cinder-822822-3-iscsi devstack@n-api.service[124373]: Wed Jul 20 09:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!